2023-11-26 15:53:14,668 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-11-26 15:53:14,906 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807 2023-11-26 15:53:14,919 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-11-26 15:53:14,919 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/cluster_7fe8813b-4787-298e-1dce-07c929e273b6, deleteOnExit=true 2023-11-26 15:53:14,920 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-11-26 15:53:14,920 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/test.cache.data in system properties and HBase conf 2023-11-26 15:53:14,920 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/hadoop.tmp.dir in system properties and HBase conf 2023-11-26 15:53:14,921 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/hadoop.log.dir in system properties and HBase conf 2023-11-26 15:53:14,922 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/mapreduce.cluster.local.dir in system properties and HBase conf 2023-11-26 15:53:14,922 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-11-26 15:53:14,922 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-11-26 15:53:15,044 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-11-26 15:53:15,486 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-11-26 15:53:15,491 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-11-26 15:53:15,491 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-11-26 15:53:15,492 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-11-26 15:53:15,492 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-26 15:53:15,492 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-11-26 15:53:15,493 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-11-26 15:53:15,493 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-26 15:53:15,494 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-26 15:53:15,494 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-11-26 15:53:15,494 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/nfs.dump.dir in system properties and HBase conf 2023-11-26 15:53:15,495 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/java.io.tmpdir in system properties and HBase conf 2023-11-26 15:53:15,495 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-26 15:53:15,496 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-11-26 15:53:15,496 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-11-26 15:53:16,175 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-26 15:53:16,181 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-26 15:53:16,530 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-11-26 15:53:16,744 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-11-26 15:53:16,764 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-26 15:53:16,817 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-11-26 15:53:16,862 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/java.io.tmpdir/Jetty_localhost_35625_hdfs____9xnaip/webapp 2023-11-26 15:53:17,008 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35625 2023-11-26 15:53:17,020 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-26 15:53:17,020 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-26 15:53:17,594 WARN [Listener at localhost/41123] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-26 15:53:17,677 WARN [Listener at localhost/41123] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-11-26 15:53:17,697 WARN [Listener at localhost/41123] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-26 15:53:17,705 INFO [Listener at localhost/41123] log.Slf4jLog(67): jetty-6.1.26 2023-11-26 15:53:17,711 INFO [Listener at localhost/41123] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/java.io.tmpdir/Jetty_localhost_33059_datanode____m0i7a3/webapp 2023-11-26 15:53:17,850 INFO [Listener at localhost/41123] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33059 2023-11-26 15:53:18,221 WARN [Listener at localhost/43645] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-26 15:53:18,735 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5db40459c92e1d2b: Processing first storage report for DS-36edaccf-0276-4c97-a818-46c396d7b484 from datanode 2bf127e4-ef8a-483d-a0ec-2a7b5791219a 2023-11-26 15:53:18,737 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5db40459c92e1d2b: from storage DS-36edaccf-0276-4c97-a818-46c396d7b484 node DatanodeRegistration(127.0.0.1:35319, datanodeUuid=2bf127e4-ef8a-483d-a0ec-2a7b5791219a, infoPort=39271, infoSecurePort=0, ipcPort=43645, storageInfo=lv=-57;cid=testClusterID;nsid=932485838;c=1701013996280), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-11-26 15:53:18,737 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5db40459c92e1d2b: Processing first storage report for DS-0ac5145c-3cb7-4bbb-822f-85275d3563af from datanode 2bf127e4-ef8a-483d-a0ec-2a7b5791219a 2023-11-26 15:53:18,737 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5db40459c92e1d2b: from storage DS-0ac5145c-3cb7-4bbb-822f-85275d3563af node DatanodeRegistration(127.0.0.1:35319, datanodeUuid=2bf127e4-ef8a-483d-a0ec-2a7b5791219a, infoPort=39271, infoSecurePort=0, ipcPort=43645, storageInfo=lv=-57;cid=testClusterID;nsid=932485838;c=1701013996280), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-11-26 15:53:18,820 DEBUG [Listener at localhost/43645] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807 2023-11-26 15:53:18,932 INFO [Listener at localhost/43645] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/cluster_7fe8813b-4787-298e-1dce-07c929e273b6/zookeeper_0, clientPort=58210, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/cluster_7fe8813b-4787-298e-1dce-07c929e273b6/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/cluster_7fe8813b-4787-298e-1dce-07c929e273b6/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-11-26 15:53:18,946 INFO [Listener at localhost/43645] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58210 2023-11-26 15:53:18,957 INFO [Listener at localhost/43645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-26 15:53:18,959 INFO [Listener at localhost/43645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-26 15:53:19,632 INFO [Listener at localhost/43645] util.FSUtils(471): Created version file at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b with version=8 2023-11-26 15:53:19,632 INFO [Listener at localhost/43645] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/hbase-staging 2023-11-26 15:53:19,939 INFO [Listener at localhost/43645] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-11-26 15:53:20,387 INFO [Listener at localhost/43645] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=3 2023-11-26 15:53:20,419 INFO [Listener at localhost/43645] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-26 15:53:20,419 INFO [Listener at localhost/43645] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-26 15:53:20,419 INFO [Listener at localhost/43645] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-26 15:53:20,420 INFO [Listener at localhost/43645] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-26 15:53:20,420 INFO [Listener at localhost/43645] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-26 15:53:20,563 INFO [Listener at localhost/43645] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-11-26 15:53:20,638 DEBUG [Listener at localhost/43645] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-11-26 15:53:20,733 INFO [Listener at localhost/43645] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33415 2023-11-26 15:53:20,743 INFO [Listener at localhost/43645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-26 15:53:20,745 INFO [Listener at localhost/43645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-26 15:53:20,768 INFO [Listener at localhost/43645] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33415 connecting to ZooKeeper ensemble=127.0.0.1:58210 2023-11-26 15:53:20,810 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:334150x0, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-26 15:53:20,812 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33415-0x1002a65b15c0000 connected 2023-11-26 15:53:20,844 DEBUG [Listener at localhost/43645] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-26 15:53:20,845 DEBUG [Listener at localhost/43645] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-26 15:53:20,848 DEBUG [Listener at localhost/43645] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-26 15:53:20,856 DEBUG [Listener at localhost/43645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33415 2023-11-26 15:53:20,856 DEBUG [Listener at localhost/43645] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33415 2023-11-26 15:53:20,857 DEBUG [Listener at localhost/43645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33415 2023-11-26 15:53:20,858 DEBUG [Listener at localhost/43645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33415 2023-11-26 15:53:20,860 DEBUG [Listener at localhost/43645] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33415 2023-11-26 15:53:20,866 INFO [Listener at localhost/43645] master.HMaster(444): hbase.rootdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b, hbase.cluster.distributed=false 2023-11-26 15:53:20,937 INFO [Listener at localhost/43645] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-11-26 15:53:20,938 INFO [Listener at localhost/43645] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-26 15:53:20,938 INFO [Listener at localhost/43645] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-26 15:53:20,938 INFO [Listener at localhost/43645] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-26 15:53:20,938 INFO [Listener at localhost/43645] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-26 15:53:20,938 INFO [Listener at localhost/43645] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-26 15:53:20,943 INFO [Listener at localhost/43645] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-11-26 15:53:20,946 INFO [Listener at localhost/43645] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41861 2023-11-26 15:53:20,949 INFO [Listener at localhost/43645] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-11-26 15:53:20,955 DEBUG [Listener at localhost/43645] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-11-26 15:53:20,956 INFO [Listener at localhost/43645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-26 15:53:20,959 INFO [Listener at localhost/43645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-26 15:53:20,961 INFO [Listener at localhost/43645] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41861 connecting to ZooKeeper ensemble=127.0.0.1:58210 2023-11-26 15:53:20,965 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:418610x0, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-26 15:53:20,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41861-0x1002a65b15c0001 connected 2023-11-26 15:53:20,967 DEBUG [Listener at localhost/43645] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-26 15:53:20,968 DEBUG [Listener at localhost/43645] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-26 15:53:20,969 DEBUG [Listener at localhost/43645] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-26 15:53:20,970 DEBUG [Listener at localhost/43645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41861 2023-11-26 15:53:20,970 DEBUG [Listener at localhost/43645] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41861 2023-11-26 15:53:20,970 DEBUG [Listener at localhost/43645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41861 2023-11-26 15:53:20,972 DEBUG [Listener at localhost/43645] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41861 2023-11-26 15:53:20,976 DEBUG [Listener at localhost/43645] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41861 2023-11-26 15:53:20,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33415,1701013999777 2023-11-26 15:53:20,987 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-26 15:53:20,990 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33415,1701013999777 2023-11-26 15:53:21,012 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-26 15:53:21,012 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-26 15:53:21,013 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-26 15:53:21,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-26 15:53:21,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33415,1701013999777 from backup master directory 2023-11-26 15:53:21,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-26 15:53:21,018 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33415,1701013999777 2023-11-26 15:53:21,019 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-26 15:53:21,019 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-26 15:53:21,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33415,1701013999777 2023-11-26 15:53:21,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-11-26 15:53:21,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-11-26 15:53:21,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/hbase.id with ID: df8e1cf5-565d-4b82-8aa0-a8ea2ef2f73c 2023-11-26 15:53:21,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-26 15:53:21,171 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-26 15:53:21,211 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x75291fd7 to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:53:21,243 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66291e97, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:53:21,265 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-11-26 15:53:21,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-11-26 15:53:21,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-11-26 15:53:21,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-11-26 15:53:21,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-26 15:53:21,289 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-26 15:53:21,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-26 15:53:21,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/MasterData/data/master/store-tmp 2023-11-26 15:53:21,368 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:53:21,369 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-26 15:53:21,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-26 15:53:21,369 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-26 15:53:21,369 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-26 15:53:21,369 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-26 15:53:21,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-26 15:53:21,369 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-26 15:53:21,370 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/MasterData/WALs/jenkins-hbase4.apache.org,33415,1701013999777 2023-11-26 15:53:21,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33415%2C1701013999777, suffix=, logDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/MasterData/WALs/jenkins-hbase4.apache.org,33415,1701013999777, archiveDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/MasterData/oldWALs, maxLogs=10 2023-11-26 15:53:21,464 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35319,DS-36edaccf-0276-4c97-a818-46c396d7b484,DISK] 2023-11-26 15:53:21,471 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-11-26 15:53:21,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/MasterData/WALs/jenkins-hbase4.apache.org,33415,1701013999777/jenkins-hbase4.apache.org%2C33415%2C1701013999777.1701014001414 2023-11-26 15:53:21,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35319,DS-36edaccf-0276-4c97-a818-46c396d7b484,DISK]] 2023-11-26 15:53:21,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-11-26 15:53:21,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:53:21,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-11-26 15:53:21,538 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-11-26 15:53:21,597 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-11-26 15:53:21,605 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-11-26 15:53:21,637 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-11-26 15:53:21,649 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:53:21,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-26 15:53:21,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-26 15:53:21,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-11-26 15:53:21,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:53:21,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59022421, jitterRate=-0.12049739062786102}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-26 15:53:21,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-26 15:53:21,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-11-26 15:53:21,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-11-26 15:53:21,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-11-26 15:53:21,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-11-26 15:53:21,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-11-26 15:53:21,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 32 msec 2023-11-26 15:53:21,746 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-11-26 15:53:21,771 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-11-26 15:53:21,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-11-26 15:53:21,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-11-26 15:53:21,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-11-26 15:53:21,809 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-11-26 15:53:21,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-11-26 15:53:21,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-11-26 15:53:21,822 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-26 15:53:21,823 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-11-26 15:53:21,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-11-26 15:53:21,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-11-26 15:53:21,840 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-26 15:53:21,841 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-26 15:53:21,841 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-26 15:53:21,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,33415,1701013999777, sessionid=0x1002a65b15c0000, setting cluster-up flag (Was=false) 2023-11-26 15:53:21,858 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-26 15:53:21,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-11-26 15:53:21,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33415,1701013999777 2023-11-26 15:53:21,873 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-26 15:53:21,880 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-11-26 15:53:21,881 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33415,1701013999777 2023-11-26 15:53:21,884 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.hbase-snapshot/.tmp 2023-11-26 15:53:21,981 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(954): ClusterId : df8e1cf5-565d-4b82-8aa0-a8ea2ef2f73c 2023-11-26 15:53:21,987 DEBUG [RS:0;jenkins-hbase4:41861] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-11-26 15:53:21,992 DEBUG [RS:0;jenkins-hbase4:41861] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-11-26 15:53:21,993 DEBUG [RS:0;jenkins-hbase4:41861] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-11-26 15:53:21,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-11-26 15:53:21,996 DEBUG [RS:0;jenkins-hbase4:41861] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-11-26 15:53:21,999 DEBUG [RS:0;jenkins-hbase4:41861] zookeeper.ReadOnlyZKClient(139): Connect 0x64765258 to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:53:22,005 DEBUG [RS:0;jenkins-hbase4:41861] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ab1a0a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:53:22,005 DEBUG [RS:0;jenkins-hbase4:41861] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e8e3928, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-26 15:53:22,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-26 15:53:22,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-26 15:53:22,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-26 15:53:22,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-26 15:53:22,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-11-26 15:53:22,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-26 15:53:22,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-26 15:53:22,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-26 15:53:22,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1701014032011 2023-11-26 15:53:22,013 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-11-26 15:53:22,020 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-11-26 15:53:22,021 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-11-26 15:53:22,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-11-26 15:53:22,026 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-26 15:53:22,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-11-26 15:53:22,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-11-26 15:53:22,034 DEBUG [RS:0;jenkins-hbase4:41861] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41861 2023-11-26 15:53:22,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-11-26 15:53:22,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-11-26 15:53:22,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-26 15:53:22,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-11-26 15:53:22,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-11-26 15:53:22,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-11-26 15:53:22,039 INFO [RS:0;jenkins-hbase4:41861] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-11-26 15:53:22,040 INFO [RS:0;jenkins-hbase4:41861] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-11-26 15:53:22,040 DEBUG [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(1025): About to register with Master. 2023-11-26 15:53:22,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-11-26 15:53:22,042 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-11-26 15:53:22,043 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase4.apache.org,33415,1701013999777 with isa=jenkins-hbase4.apache.org/172.31.14.131:41861, startcode=1701014000937 2023-11-26 15:53:22,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1701014002043,5,FailOnTimeoutGroup] 2023-11-26 15:53:22,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1701014002045,5,FailOnTimeoutGroup] 2023-11-26 15:53:22,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-26 15:53:22,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-11-26 15:53:22,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-11-26 15:53:22,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-11-26 15:53:22,061 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-26 15:53:22,062 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-26 15:53:22,063 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b 2023-11-26 15:53:22,064 DEBUG [RS:0;jenkins-hbase4:41861] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-11-26 15:53:22,082 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:53:22,085 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-26 15:53:22,088 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/info 2023-11-26 15:53:22,091 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-26 15:53:22,092 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:53:22,093 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-26 15:53:22,096 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/rep_barrier 2023-11-26 15:53:22,097 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-26 15:53:22,097 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:53:22,098 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-26 15:53:22,102 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/table 2023-11-26 15:53:22,103 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-26 15:53:22,103 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:53:22,105 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740 2023-11-26 15:53:22,106 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740 2023-11-26 15:53:22,111 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-26 15:53:22,113 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-26 15:53:22,118 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:53:22,119 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47903, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-11-26 15:53:22,119 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67285032, jitterRate=0.002625107765197754}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-26 15:53:22,119 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-26 15:53:22,119 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-26 15:53:22,119 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-26 15:53:22,119 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-26 15:53:22,119 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-26 15:53:22,119 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-26 15:53:22,120 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-26 15:53:22,121 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-26 15:53:22,126 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-11-26 15:53:22,127 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-11-26 15:53:22,130 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33415] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:22,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-11-26 15:53:22,146 DEBUG [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b 2023-11-26 15:53:22,146 DEBUG [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:41123 2023-11-26 15:53:22,146 DEBUG [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2023-11-26 15:53:22,147 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-11-26 15:53:22,149 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-11-26 15:53:22,154 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-26 15:53:22,155 DEBUG [RS:0;jenkins-hbase4:41861] zookeeper.ZKUtil(163): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:22,155 WARN [RS:0;jenkins-hbase4:41861] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-26 15:53:22,156 INFO [RS:0;jenkins-hbase4:41861] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-26 15:53:22,156 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41861,1701014000937] 2023-11-26 15:53:22,156 DEBUG [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(1951): logDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/WALs/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:22,167 DEBUG [RS:0;jenkins-hbase4:41861] zookeeper.ZKUtil(163): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:22,177 DEBUG [RS:0;jenkins-hbase4:41861] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-11-26 15:53:22,185 INFO [RS:0;jenkins-hbase4:41861] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-11-26 15:53:22,202 INFO [RS:0;jenkins-hbase4:41861] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-11-26 15:53:22,205 INFO [RS:0;jenkins-hbase4:41861] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-26 15:53:22,205 INFO [RS:0;jenkins-hbase4:41861] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:53:22,207 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2023-11-26 15:53:22,214 INFO [RS:0;jenkins-hbase4:41861] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-11-26 15:53:22,214 DEBUG [RS:0;jenkins-hbase4:41861] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-26 15:53:22,214 DEBUG [RS:0;jenkins-hbase4:41861] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-26 15:53:22,214 DEBUG [RS:0;jenkins-hbase4:41861] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-26 15:53:22,214 DEBUG [RS:0;jenkins-hbase4:41861] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-26 15:53:22,215 DEBUG [RS:0;jenkins-hbase4:41861] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-26 15:53:22,215 DEBUG [RS:0;jenkins-hbase4:41861] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-26 15:53:22,215 DEBUG [RS:0;jenkins-hbase4:41861] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-26 15:53:22,215 DEBUG [RS:0;jenkins-hbase4:41861] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-26 15:53:22,215 DEBUG [RS:0;jenkins-hbase4:41861] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-26 15:53:22,215 DEBUG [RS:0;jenkins-hbase4:41861] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-26 15:53:22,218 INFO [RS:0;jenkins-hbase4:41861] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-11-26 15:53:22,218 INFO [RS:0;jenkins-hbase4:41861] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-11-26 15:53:22,218 INFO [RS:0;jenkins-hbase4:41861] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-11-26 15:53:22,243 INFO [RS:0;jenkins-hbase4:41861] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-11-26 15:53:22,245 INFO [RS:0;jenkins-hbase4:41861] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41861,1701014000937-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:53:22,261 INFO [RS:0;jenkins-hbase4:41861] regionserver.Replication(203): jenkins-hbase4.apache.org,41861,1701014000937 started 2023-11-26 15:53:22,261 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,41861,1701014000937, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41861, sessionid=0x1002a65b15c0001 2023-11-26 15:53:22,261 DEBUG [RS:0;jenkins-hbase4:41861] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-11-26 15:53:22,261 DEBUG [RS:0;jenkins-hbase4:41861] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:22,261 DEBUG [RS:0;jenkins-hbase4:41861] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41861,1701014000937' 2023-11-26 15:53:22,261 DEBUG [RS:0;jenkins-hbase4:41861] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:22,262 DEBUG [RS:0;jenkins-hbase4:41861] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:22,263 DEBUG [RS:0;jenkins-hbase4:41861] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-11-26 15:53:22,263 DEBUG [RS:0;jenkins-hbase4:41861] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-11-26 15:53:22,263 DEBUG [RS:0;jenkins-hbase4:41861] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:22,263 DEBUG [RS:0;jenkins-hbase4:41861] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41861,1701014000937' 2023-11-26 15:53:22,263 DEBUG [RS:0;jenkins-hbase4:41861] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-26 15:53:22,264 DEBUG [RS:0;jenkins-hbase4:41861] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-26 15:53:22,264 DEBUG [RS:0;jenkins-hbase4:41861] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-11-26 15:53:22,264 INFO [RS:0;jenkins-hbase4:41861] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-11-26 15:53:22,264 INFO [RS:0;jenkins-hbase4:41861] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-11-26 15:53:22,301 DEBUG [jenkins-hbase4:33415] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-11-26 15:53:22,304 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41861,1701014000937, state=OPENING 2023-11-26 15:53:22,311 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-11-26 15:53:22,313 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-26 15:53:22,314 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-26 15:53:22,317 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:53:22,375 INFO [RS:0;jenkins-hbase4:41861] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41861%2C1701014000937, suffix=, logDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/WALs/jenkins-hbase4.apache.org,41861,1701014000937, archiveDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/oldWALs, maxLogs=32 2023-11-26 15:53:22,402 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35319,DS-36edaccf-0276-4c97-a818-46c396d7b484,DISK] 2023-11-26 15:53:22,406 INFO [RS:0;jenkins-hbase4:41861] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/WALs/jenkins-hbase4.apache.org,41861,1701014000937/jenkins-hbase4.apache.org%2C41861%2C1701014000937.1701014002379 2023-11-26 15:53:22,406 DEBUG [RS:0;jenkins-hbase4:41861] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35319,DS-36edaccf-0276-4c97-a818-46c396d7b484,DISK]] 2023-11-26 15:53:22,501 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:22,503 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-26 15:53:22,507 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57154, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-26 15:53:22,518 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-11-26 15:53:22,518 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-26 15:53:22,522 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41861%2C1701014000937.meta, suffix=.meta, logDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/WALs/jenkins-hbase4.apache.org,41861,1701014000937, archiveDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/oldWALs, maxLogs=32 2023-11-26 15:53:22,538 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35319,DS-36edaccf-0276-4c97-a818-46c396d7b484,DISK] 2023-11-26 15:53:22,542 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/WALs/jenkins-hbase4.apache.org,41861,1701014000937/jenkins-hbase4.apache.org%2C41861%2C1701014000937.meta.1701014002523.meta 2023-11-26 15:53:22,542 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35319,DS-36edaccf-0276-4c97-a818-46c396d7b484,DISK]] 2023-11-26 15:53:22,543 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-11-26 15:53:22,544 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-11-26 15:53:22,562 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-11-26 15:53:22,567 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-11-26 15:53:22,573 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-11-26 15:53:22,573 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:53:22,573 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-11-26 15:53:22,573 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-11-26 15:53:22,576 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-26 15:53:22,578 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/info 2023-11-26 15:53:22,578 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/info 2023-11-26 15:53:22,578 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-26 15:53:22,579 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:53:22,580 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-26 15:53:22,581 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/rep_barrier 2023-11-26 15:53:22,581 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/rep_barrier 2023-11-26 15:53:22,582 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-26 15:53:22,582 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:53:22,583 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-26 15:53:22,584 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/table 2023-11-26 15:53:22,584 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/table 2023-11-26 15:53:22,585 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-26 15:53:22,586 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:53:22,587 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740 2023-11-26 15:53:22,590 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740 2023-11-26 15:53:22,593 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-26 15:53:22,595 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-26 15:53:22,596 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59260894, jitterRate=-0.11694386601448059}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-26 15:53:22,597 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-26 15:53:22,606 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1701014002493 2023-11-26 15:53:22,622 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:meta,,1.1588230740 2023-11-26 15:53:22,623 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-11-26 15:53:22,624 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41861,1701014000937, state=OPEN 2023-11-26 15:53:22,631 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-11-26 15:53:22,631 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-26 15:53:22,635 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=3, resume processing ppid=2 2023-11-26 15:53:22,636 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41861,1701014000937 in 314 msec 2023-11-26 15:53:22,640 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=2, resume processing ppid=1 2023-11-26 15:53:22,640 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 501 msec 2023-11-26 15:53:22,646 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 718 msec 2023-11-26 15:53:22,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1701014002647, completionTime=-1 2023-11-26 15:53:22,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-11-26 15:53:22,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-11-26 15:53:22,709 DEBUG [hconnection-0x52818ac1-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:53:22,713 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57158, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:53:22,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-11-26 15:53:22,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1701014062729 2023-11-26 15:53:22,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1701014122729 2023-11-26 15:53:22,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 82 msec 2023-11-26 15:53:22,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33415,1701013999777-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:53:22,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33415,1701013999777-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-26 15:53:22,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33415,1701013999777-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-26 15:53:22,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33415, period=300000, unit=MILLISECONDS is enabled. 2023-11-26 15:53:22,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-11-26 15:53:22,761 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-11-26 15:53:22,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-11-26 15:53:22,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-26 15:53:22,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-11-26 15:53:22,781 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-11-26 15:53:22,783 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-26 15:53:22,804 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/hbase/namespace/88c67e38620ab4e718a57f53e9db97ae 2023-11-26 15:53:22,806 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/hbase/namespace/88c67e38620ab4e718a57f53e9db97ae empty. 2023-11-26 15:53:22,807 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/hbase/namespace/88c67e38620ab4e718a57f53e9db97ae 2023-11-26 15:53:22,807 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-11-26 15:53:23,229 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-11-26 15:53:23,232 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 88c67e38620ab4e718a57f53e9db97ae, NAME => 'hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:53:23,248 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:53:23,248 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 88c67e38620ab4e718a57f53e9db97ae, disabling compactions & flushes 2023-11-26 15:53:23,248 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae. 2023-11-26 15:53:23,249 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae. 2023-11-26 15:53:23,249 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae. after waiting 0 ms 2023-11-26 15:53:23,249 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae. 2023-11-26 15:53:23,249 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae. 2023-11-26 15:53:23,249 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 88c67e38620ab4e718a57f53e9db97ae: 2023-11-26 15:53:23,254 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-11-26 15:53:23,270 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1701014003258"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014003258"}]},"ts":"1701014003258"} 2023-11-26 15:53:23,295 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-26 15:53:23,297 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-26 15:53:23,301 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014003297"}]},"ts":"1701014003297"} 2023-11-26 15:53:23,304 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-11-26 15:53:23,312 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=88c67e38620ab4e718a57f53e9db97ae, ASSIGN}] 2023-11-26 15:53:23,315 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=88c67e38620ab4e718a57f53e9db97ae, ASSIGN 2023-11-26 15:53:23,316 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=88c67e38620ab4e718a57f53e9db97ae, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:53:23,467 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=88c67e38620ab4e718a57f53e9db97ae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:23,468 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1701014003467"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014003467"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014003467"}]},"ts":"1701014003467"} 2023-11-26 15:53:23,475 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 88c67e38620ab4e718a57f53e9db97ae, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:53:23,629 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:23,636 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae. 2023-11-26 15:53:23,636 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 88c67e38620ab4e718a57f53e9db97ae, NAME => 'hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae.', STARTKEY => '', ENDKEY => ''} 2023-11-26 15:53:23,637 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 88c67e38620ab4e718a57f53e9db97ae 2023-11-26 15:53:23,638 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:53:23,638 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 88c67e38620ab4e718a57f53e9db97ae 2023-11-26 15:53:23,638 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 88c67e38620ab4e718a57f53e9db97ae 2023-11-26 15:53:23,640 INFO [StoreOpener-88c67e38620ab4e718a57f53e9db97ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 88c67e38620ab4e718a57f53e9db97ae 2023-11-26 15:53:23,643 DEBUG [StoreOpener-88c67e38620ab4e718a57f53e9db97ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/namespace/88c67e38620ab4e718a57f53e9db97ae/info 2023-11-26 15:53:23,643 DEBUG [StoreOpener-88c67e38620ab4e718a57f53e9db97ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/namespace/88c67e38620ab4e718a57f53e9db97ae/info 2023-11-26 15:53:23,643 INFO [StoreOpener-88c67e38620ab4e718a57f53e9db97ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88c67e38620ab4e718a57f53e9db97ae columnFamilyName info 2023-11-26 15:53:23,644 INFO [StoreOpener-88c67e38620ab4e718a57f53e9db97ae-1] regionserver.HStore(310): Store=88c67e38620ab4e718a57f53e9db97ae/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:53:23,646 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/namespace/88c67e38620ab4e718a57f53e9db97ae 2023-11-26 15:53:23,646 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/namespace/88c67e38620ab4e718a57f53e9db97ae 2023-11-26 15:53:23,651 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 88c67e38620ab4e718a57f53e9db97ae 2023-11-26 15:53:23,655 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/namespace/88c67e38620ab4e718a57f53e9db97ae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:53:23,656 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 88c67e38620ab4e718a57f53e9db97ae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70029343, jitterRate=0.04351852834224701}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-26 15:53:23,656 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 88c67e38620ab4e718a57f53e9db97ae: 2023-11-26 15:53:23,658 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae., pid=6, masterSystemTime=1701014003629 2023-11-26 15:53:23,662 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae. 2023-11-26 15:53:23,662 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae. 2023-11-26 15:53:23,664 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=88c67e38620ab4e718a57f53e9db97ae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:23,665 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1701014003663"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014003663"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014003663"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014003663"}]},"ts":"1701014003663"} 2023-11-26 15:53:23,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=6, resume processing ppid=5 2023-11-26 15:53:23,674 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 88c67e38620ab4e718a57f53e9db97ae, server=jenkins-hbase4.apache.org,41861,1701014000937 in 194 msec 2023-11-26 15:53:23,677 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=5, resume processing ppid=4 2023-11-26 15:53:23,677 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=88c67e38620ab4e718a57f53e9db97ae, ASSIGN in 361 msec 2023-11-26 15:53:23,679 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-26 15:53:23,680 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014003679"}]},"ts":"1701014003679"} 2023-11-26 15:53:23,682 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-11-26 15:53:23,686 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-11-26 15:53:23,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-11-26 15:53:23,688 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-11-26 15:53:23,688 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-26 15:53:23,689 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 915 msec 2023-11-26 15:53:23,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-11-26 15:53:23,748 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-26 15:53:23,755 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 34 msec 2023-11-26 15:53:23,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-11-26 15:53:23,777 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-26 15:53:23,783 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-11-26 15:53:23,793 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-26 15:53:23,795 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-11-26 15:53:23,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.777sec 2023-11-26 15:53:23,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-11-26 15:53:23,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-11-26 15:53:23,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-11-26 15:53:23,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33415,1701013999777-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-11-26 15:53:23,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33415,1701013999777-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-11-26 15:53:23,812 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-11-26 15:53:23,888 DEBUG [Listener at localhost/43645] zookeeper.ReadOnlyZKClient(139): Connect 0x0b2a962e to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:53:23,893 DEBUG [Listener at localhost/43645] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79a41f20, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:53:23,906 DEBUG [hconnection-0x6295a77a-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:53:23,916 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57174, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:53:23,926 INFO [Listener at localhost/43645] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33415,1701013999777 2023-11-26 15:53:23,928 DEBUG [Listener at localhost/43645] zookeeper.ReadOnlyZKClient(139): Connect 0x7faa020d to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:53:23,933 DEBUG [Listener at localhost/43645] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41eb7af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:53:23,933 INFO [Listener at localhost/43645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-26 15:53:23,988 INFO [Listener at localhost/43645] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=214, OpenFileDescriptor=505, MaxFileDescriptor=60000, SystemLoadAverage=386, ProcessCount=172, AvailableMemoryMB=8571 2023-11-26 15:53:24,000 DEBUG [Listener at localhost/43645] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-26 15:53:24,004 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-26 15:53:24,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-26 15:53:24,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:24,021 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-26 15:53:24,023 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-26 15:53:24,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-11-26 15:53:24,026 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe 2023-11-26 15:53:24,027 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe empty. 2023-11-26 15:53:24,029 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe 2023-11-26 15:53:24,029 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-11-26 15:53:24,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-26 15:53:24,047 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-26 15:53:24,049 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => c250ec54ecf7a7b68d0c6e162cb264fe, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:53:24,060 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:53:24,061 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing c250ec54ecf7a7b68d0c6e162cb264fe, disabling compactions & flushes 2023-11-26 15:53:24,061 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:24,061 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:24,061 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. after waiting 0 ms 2023-11-26 15:53:24,061 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:24,061 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:24,061 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for c250ec54ecf7a7b68d0c6e162cb264fe: 2023-11-26 15:53:24,065 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-11-26 15:53:24,067 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701014004067"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014004067"}]},"ts":"1701014004067"} 2023-11-26 15:53:24,070 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-26 15:53:24,071 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-26 15:53:24,071 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014004071"}]},"ts":"1701014004071"} 2023-11-26 15:53:24,073 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-11-26 15:53:24,077 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c250ec54ecf7a7b68d0c6e162cb264fe, ASSIGN}] 2023-11-26 15:53:24,079 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c250ec54ecf7a7b68d0c6e162cb264fe, ASSIGN 2023-11-26 15:53:24,081 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c250ec54ecf7a7b68d0c6e162cb264fe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:53:24,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-26 15:53:24,232 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=c250ec54ecf7a7b68d0c6e162cb264fe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:24,232 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701014004232"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014004232"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014004232"}]},"ts":"1701014004232"} 2023-11-26 15:53:24,236 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure c250ec54ecf7a7b68d0c6e162cb264fe, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:53:24,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-26 15:53:24,389 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:24,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:24,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c250ec54ecf7a7b68d0c6e162cb264fe, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe.', STARTKEY => '', ENDKEY => ''} 2023-11-26 15:53:24,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly c250ec54ecf7a7b68d0c6e162cb264fe 2023-11-26 15:53:24,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:53:24,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c250ec54ecf7a7b68d0c6e162cb264fe 2023-11-26 15:53:24,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c250ec54ecf7a7b68d0c6e162cb264fe 2023-11-26 15:53:24,400 INFO [StoreOpener-c250ec54ecf7a7b68d0c6e162cb264fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c250ec54ecf7a7b68d0c6e162cb264fe 2023-11-26 15:53:24,402 DEBUG [StoreOpener-c250ec54ecf7a7b68d0c6e162cb264fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1 2023-11-26 15:53:24,403 DEBUG [StoreOpener-c250ec54ecf7a7b68d0c6e162cb264fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1 2023-11-26 15:53:24,405 INFO [StoreOpener-c250ec54ecf7a7b68d0c6e162cb264fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c250ec54ecf7a7b68d0c6e162cb264fe columnFamilyName family1 2023-11-26 15:53:24,409 INFO [StoreOpener-c250ec54ecf7a7b68d0c6e162cb264fe-1] regionserver.HStore(310): Store=c250ec54ecf7a7b68d0c6e162cb264fe/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:53:24,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe 2023-11-26 15:53:24,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe 2023-11-26 15:53:24,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c250ec54ecf7a7b68d0c6e162cb264fe 2023-11-26 15:53:24,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:53:24,421 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c250ec54ecf7a7b68d0c6e162cb264fe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64796393, jitterRate=-0.034458503127098083}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-26 15:53:24,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c250ec54ecf7a7b68d0c6e162cb264fe: 2023-11-26 15:53:24,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe., pid=11, masterSystemTime=1701014004389 2023-11-26 15:53:24,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:24,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:24,427 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=c250ec54ecf7a7b68d0c6e162cb264fe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:24,427 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701014004427"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014004427"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014004427"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014004427"}]},"ts":"1701014004427"} 2023-11-26 15:53:24,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=11, resume processing ppid=10 2023-11-26 15:53:24,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure c250ec54ecf7a7b68d0c6e162cb264fe, server=jenkins-hbase4.apache.org,41861,1701014000937 in 194 msec 2023-11-26 15:53:24,437 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=10, resume processing ppid=9 2023-11-26 15:53:24,437 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c250ec54ecf7a7b68d0c6e162cb264fe, ASSIGN in 356 msec 2023-11-26 15:53:24,438 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-26 15:53:24,439 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014004439"}]},"ts":"1701014004439"} 2023-11-26 15:53:24,441 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-11-26 15:53:24,444 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-11-26 15:53:24,447 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 427 msec 2023-11-26 15:53:24,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-26 15:53:24,646 INFO [Listener at localhost/43645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-11-26 15:53:24,668 DEBUG [hconnection-0x14b40d8c-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:53:24,671 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:53:24,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:24,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:24,830 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:24,830 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:24,831 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-26 15:53:24,831 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-26 15:53:24,832 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:24,832 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:24,838 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:24,838 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:24,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:24,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:24,839 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:24,839 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:24,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:24,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:24,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:24,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:24,841 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:24,842 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:24,843 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-26 15:53:24,843 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:24,843 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-26 15:53:24,844 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:24,844 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:24,844 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:24,845 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. started... 2023-11-26 15:53:24,845 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c250ec54ecf7a7b68d0c6e162cb264fe 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-26 15:53:25,391 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e0b696b008bb496caa5e0047b43d7133 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130e0b696b008bb496caa5e0047b43d7133 2023-11-26 15:53:25,809 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/a4297a89234249d7b39fa1243f4a3aaa 2023-11-26 15:53:25,820 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/a4297a89234249d7b39fa1243f4a3aaa as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/a4297a89234249d7b39fa1243f4a3aaa 2023-11-26 15:53:25,828 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/a4297a89234249d7b39fa1243f4a3aaa, entries=1000, sequenceid=5, filesize=175.8 K 2023-11-26 15:53:25,832 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for c250ec54ecf7a7b68d0c6e162cb264fe in 987ms, sequenceid=5, compaction requested=false 2023-11-26 15:53:25,833 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:25,836 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c250ec54ecf7a7b68d0c6e162cb264fe: 2023-11-26 15:53:25,836 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:25,836 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:25,836 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:25,836 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:25,837 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-26 15:53:25,837 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-26 15:53:25,840 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:25,840 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:25,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:25,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:25,840 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,840 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:25,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:25,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:25,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:25,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:25,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-26 15:53:25,843 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-26 15:53:25,843 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5822c3b2[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:25,843 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,845 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,845 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-26 15:53:25,845 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:25,845 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:25,845 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-26 15:53:25,846 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:25,848 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:25,848 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-26 15:53:25,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:25,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:25,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:25,848 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:25,849 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-26 15:53:25,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:25,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:25,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:25,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:25,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:25,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:25,853 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-26 15:53:25,853 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:25,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-26 15:53:25,853 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:25,853 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,853 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:25,857 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,857 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,857 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:25,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:25,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:25,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:25,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:25,858 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:25,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:25,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:25,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:25,860 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:25,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:25,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:25,868 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:25,868 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,869 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,869 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:25,869 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:25,869 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,869 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,869 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:25,869 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:25,869 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:25,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:25,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:25,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:25,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:25,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:25,872 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:25,872 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:25,972 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:25,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:25,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:25,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:25,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,991 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:25,991 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:25,991 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-26 15:53:25,991 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-26 15:53:25,992 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,992 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,996 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:25,996 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:25,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:25,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:25,997 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:25,997 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:25,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,997 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:25,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,998 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,998 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-26 15:53:25,998 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:25,998 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-26 15:53:25,998 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:25,999 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-26 15:53:25,999 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:25,999 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:25,999 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:25,999 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. started... 2023-11-26 15:53:25,999 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c250ec54ecf7a7b68d0c6e162cb264fe 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-26 15:53:26,427 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128ebbd29f776af45e98c9cd73721abd1a4 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128ebbd29f776af45e98c9cd73721abd1a4 2023-11-26 15:53:26,840 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/c5218bd445124f6186fbc565d19524b3 2023-11-26 15:53:26,850 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/c5218bd445124f6186fbc565d19524b3 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/c5218bd445124f6186fbc565d19524b3 2023-11-26 15:53:26,858 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/c5218bd445124f6186fbc565d19524b3, entries=1, sequenceid=9, filesize=5.0 K 2023-11-26 15:53:26,860 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for c250ec54ecf7a7b68d0c6e162cb264fe in 861ms, sequenceid=9, compaction requested=false 2023-11-26 15:53:26,860 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c250ec54ecf7a7b68d0c6e162cb264fe: 2023-11-26 15:53:26,860 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:26,860 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:26,860 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:26,861 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:26,861 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-26 15:53:26,861 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-26 15:53:26,864 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:26,864 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:26,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:26,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:26,865 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,865 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:26,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:26,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:26,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:26,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:26,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-26 15:53:26,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bb6f9e1[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:26,867 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-26 15:53:26,867 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,869 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,869 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-26 15:53:26,869 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-26 15:53:26,869 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:26,869 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:26,869 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:26,871 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-26 15:53:26,871 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:26,871 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:26,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:26,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:26,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:26,871 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-26 15:53:26,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:26,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:26,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:26,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:26,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:26,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:26,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-26 15:53:26,875 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-26 15:53:26,875 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:26,875 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:26,875 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,875 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:26,877 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,877 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,877 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:26,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:26,878 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:26,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,880 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:26,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:26,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:26,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:26,888 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:26,888 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,888 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:26,888 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:26,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:26,888 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:26,888 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:26,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:26,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:26,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-26 15:53:26,888 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,888 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:26,889 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,889 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:26,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:26,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:26,889 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:26,889 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:26,990 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:26,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:26,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:27,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:27,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,002 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:27,002 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:27,003 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-26 15:53:27,003 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-26 15:53:27,004 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,004 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,005 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:27,005 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:27,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:27,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:27,006 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:27,006 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:27,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,007 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:27,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,007 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,008 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-26 15:53:27,008 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,008 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-26 15:53:27,008 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:27,008 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-26 15:53:27,009 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:27,009 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:27,009 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:27,009 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. started... 2023-11-26 15:53:27,009 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c250ec54ecf7a7b68d0c6e162cb264fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:27,435 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201f69bd30e0b4f433e913e9c17c8113a11 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201f69bd30e0b4f433e913e9c17c8113a11 2023-11-26 15:53:27,848 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/03540b5179544c4e8b95ee64852e54da 2023-11-26 15:53:27,859 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/03540b5179544c4e8b95ee64852e54da as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/03540b5179544c4e8b95ee64852e54da 2023-11-26 15:53:27,869 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/03540b5179544c4e8b95ee64852e54da, entries=1, sequenceid=13, filesize=5.0 K 2023-11-26 15:53:27,870 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c250ec54ecf7a7b68d0c6e162cb264fe in 861ms, sequenceid=13, compaction requested=true 2023-11-26 15:53:27,870 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c250ec54ecf7a7b68d0c6e162cb264fe: 2023-11-26 15:53:27,870 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:27,870 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:27,871 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:27,871 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:27,871 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-26 15:53:27,871 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-26 15:53:27,874 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:27,874 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:27,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:27,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:27,874 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,874 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:27,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:27,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:27,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:27,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:27,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-26 15:53:27,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76b4e142[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:27,877 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-26 15:53:27,877 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,878 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,879 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-26 15:53:27,879 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-26 15:53:27,879 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:27,879 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:27,879 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:27,882 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-26 15:53:27,882 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:27,882 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:27,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:27,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:27,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:27,882 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-26 15:53:27,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:27,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:27,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:27,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:27,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:27,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:27,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-26 15:53:27,886 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-26 15:53:27,887 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:27,887 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:27,887 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,887 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:27,889 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,889 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,889 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:27,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:27,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:27,890 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:27,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:27,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:27,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:27,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:27,893 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:27,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:27,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:27,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:27,898 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:27,899 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,899 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,899 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:27,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:27,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:27,899 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:27,900 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,900 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,900 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:27,900 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:27,900 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:27,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:27,901 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:27,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:27,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:27,901 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:27,902 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:27,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-26 15:53:28,002 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:28,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:28,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:28,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:28,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,016 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:28,016 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:28,016 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-26 15:53:28,016 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-26 15:53:28,017 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,017 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,019 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:28,019 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:28,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:28,020 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,020 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:28,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,020 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:28,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,021 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,021 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-26 15:53:28,021 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,021 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-26 15:53:28,021 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:28,022 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-26 15:53:28,022 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:28,022 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:28,022 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:28,022 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. started... 2023-11-26 15:53:28,022 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c250ec54ecf7a7b68d0c6e162cb264fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:28,091 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-26 15:53:28,181 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-11-26 15:53:28,182 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-11-26 15:53:28,448 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f5cbdbe6f89b4e8291df5e2a693336be to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205f5cbdbe6f89b4e8291df5e2a693336be 2023-11-26 15:53:28,460 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/ea07e936e82c49548ffcd0c0162fee4a 2023-11-26 15:53:28,469 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/ea07e936e82c49548ffcd0c0162fee4a as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/ea07e936e82c49548ffcd0c0162fee4a 2023-11-26 15:53:28,479 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/ea07e936e82c49548ffcd0c0162fee4a, entries=1, sequenceid=17, filesize=5.0 K 2023-11-26 15:53:28,481 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c250ec54ecf7a7b68d0c6e162cb264fe in 459ms, sequenceid=17, compaction requested=true 2023-11-26 15:53:28,481 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c250ec54ecf7a7b68d0c6e162cb264fe: 2023-11-26 15:53:28,481 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:28,481 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:28,482 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:28,482 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,482 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-26 15:53:28,482 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-26 15:53:28,485 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,485 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:28,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:28,486 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,486 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:28,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:28,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:28,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-26 15:53:28,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@388d4dc1[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:28,488 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-26 15:53:28,488 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,490 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,491 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-26 15:53:28,491 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-26 15:53:28,491 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:28,492 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,492 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:28,495 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-26 15:53:28,495 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,495 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:28,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:28,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:28,496 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-26 15:53:28,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:28,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:28,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:28,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:28,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-26 15:53:28,500 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-26 15:53:28,500 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:28,500 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:28,500 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,500 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:28,506 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,506 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,506 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:28,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:28,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:28,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:28,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:28,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:28,507 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:28,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,509 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:28,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,514 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,515 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,514 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:28,515 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,515 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:28,515 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:28,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:28,515 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:28,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:28,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:28,515 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,516 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,516 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,516 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:28,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:28,516 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:28,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:28,616 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:28,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:28,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:28,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:28,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,629 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:28,629 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:28,630 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-26 15:53:28,630 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-26 15:53:28,630 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,630 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,635 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,635 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:28,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:28,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:28,635 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,635 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:28,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,636 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:28,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,636 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,637 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-26 15:53:28,637 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,637 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-26 15:53:28,637 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:28,637 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-26 15:53:28,637 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:28,637 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:28,638 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:28,638 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. started... 2023-11-26 15:53:28,638 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c250ec54ecf7a7b68d0c6e162cb264fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:28,659 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228adfb2ca7c69b409d9944c665989268ef to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228adfb2ca7c69b409d9944c665989268ef 2023-11-26 15:53:28,670 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/bac4e58bddc14b54b02d9f5fcdb87f94 2023-11-26 15:53:28,678 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/bac4e58bddc14b54b02d9f5fcdb87f94 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/bac4e58bddc14b54b02d9f5fcdb87f94 2023-11-26 15:53:28,686 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/bac4e58bddc14b54b02d9f5fcdb87f94, entries=1, sequenceid=21, filesize=5.0 K 2023-11-26 15:53:28,687 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c250ec54ecf7a7b68d0c6e162cb264fe in 49ms, sequenceid=21, compaction requested=true 2023-11-26 15:53:28,687 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c250ec54ecf7a7b68d0c6e162cb264fe: 2023-11-26 15:53:28,687 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:28,687 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:28,688 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:28,688 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,688 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-26 15:53:28,688 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-26 15:53:28,690 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,690 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:28,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:28,691 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,691 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:28,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:28,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:28,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:28,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-26 15:53:28,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76fc3631[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:28,694 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-26 15:53:28,694 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,696 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,696 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-26 15:53:28,696 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-26 15:53:28,696 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:28,697 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,697 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:28,698 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,698 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-26 15:53:28,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:28,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:28,698 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:28,699 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-26 15:53:28,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:28,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:28,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:28,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:28,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-26 15:53:28,702 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-26 15:53:28,702 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:28,702 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:28,702 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,702 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:28,705 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,705 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,705 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:28,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:28,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:28,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:28,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:28,706 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:28,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,708 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,711 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,711 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,712 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,711 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:28,712 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,712 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:28,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:28,712 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:28,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:28,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:28,712 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:28,712 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,713 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:28,713 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:28,713 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:28,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:28,813 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:28,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:28,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:28,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:28,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,826 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:28,826 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:28,827 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-26 15:53:28,827 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-26 15:53:28,827 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,827 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,829 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:28,829 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:28,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:28,830 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:28,830 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:28,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:28,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,831 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,831 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-26 15:53:28,831 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:28,831 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-26 15:53:28,831 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:28,832 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-26 15:53:28,832 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:28,832 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:28,832 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:28,832 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. started... 2023-11-26 15:53:28,832 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c250ec54ecf7a7b68d0c6e162cb264fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:29,292 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231f87d516d5c1a40379c6f22a25d20afc3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231f87d516d5c1a40379c6f22a25d20afc3 2023-11-26 15:53:29,706 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/860e1c25e40448f59826916a9873c7fc 2023-11-26 15:53:29,715 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/860e1c25e40448f59826916a9873c7fc as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/860e1c25e40448f59826916a9873c7fc 2023-11-26 15:53:29,724 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/860e1c25e40448f59826916a9873c7fc, entries=1, sequenceid=25, filesize=5.0 K 2023-11-26 15:53:29,725 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c250ec54ecf7a7b68d0c6e162cb264fe in 893ms, sequenceid=25, compaction requested=true 2023-11-26 15:53:29,725 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c250ec54ecf7a7b68d0c6e162cb264fe: 2023-11-26 15:53:29,725 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:29,726 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:29,726 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:29,726 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:29,726 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-26 15:53:29,726 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-26 15:53:29,728 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,728 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:29,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:29,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:29,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:29,729 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,729 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:29,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:29,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:29,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:29,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:29,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-26 15:53:29,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a49a0fe[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:29,731 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-26 15:53:29,731 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,734 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,734 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-26 15:53:29,734 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-26 15:53:29,734 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:29,734 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:29,734 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:29,736 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-26 15:53:29,736 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:29,736 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:29,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:29,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:29,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:29,736 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-26 15:53:29,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:29,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:29,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:29,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:29,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:29,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:29,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-26 15:53:29,740 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-26 15:53:29,740 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:29,740 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:29,740 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,740 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:29,742 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,742 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:29,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:29,742 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:29,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:29,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:29,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:29,743 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:29,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:29,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,745 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:29,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:29,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:29,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:29,748 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:29,748 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:29,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:29,748 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:29,748 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:29,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:29,748 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,748 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:29,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-26 15:53:29,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:29,749 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:29,750 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:29,750 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,750 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:29,750 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,750 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:29,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:29,850 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:29,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:29,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:29,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:29,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,862 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:29,862 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:29,863 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-26 15:53:29,863 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-26 15:53:29,863 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,864 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,866 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:29,866 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:29,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:29,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:29,866 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:29,866 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:29,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:29,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,868 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,868 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-26 15:53:29,868 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:29,868 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-26 15:53:29,868 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:29,869 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-26 15:53:29,869 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:29,869 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:29,869 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:29,869 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. started... 2023-11-26 15:53:29,869 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c250ec54ecf7a7b68d0c6e162cb264fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:29,934 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-26 15:53:29,935 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-11-26 15:53:30,291 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101cc8b589ee590456ba331faf63bfb48d2 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101cc8b589ee590456ba331faf63bfb48d2 2023-11-26 15:53:30,300 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/b37cac3cdb0c417ba120834550089e77 2023-11-26 15:53:30,307 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/b37cac3cdb0c417ba120834550089e77 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/b37cac3cdb0c417ba120834550089e77 2023-11-26 15:53:30,314 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/b37cac3cdb0c417ba120834550089e77, entries=1, sequenceid=29, filesize=5.0 K 2023-11-26 15:53:30,315 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c250ec54ecf7a7b68d0c6e162cb264fe in 446ms, sequenceid=29, compaction requested=true 2023-11-26 15:53:30,316 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c250ec54ecf7a7b68d0c6e162cb264fe: 2023-11-26 15:53:30,316 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:30,316 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:30,316 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:30,316 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,316 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-26 15:53:30,316 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-26 15:53:30,321 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,321 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:30,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:30,322 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,322 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:30,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:30,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:30,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:30,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-26 15:53:30,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b26e804[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:30,324 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-26 15:53:30,324 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,325 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,326 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-26 15:53:30,326 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-26 15:53:30,326 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:30,326 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,326 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:30,328 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-26 15:53:30,328 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:30,328 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,328 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-26 15:53:30,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:30,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:30,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:30,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:30,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:30,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:30,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-26 15:53:30,332 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-26 15:53:30,332 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:30,332 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:30,332 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,332 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:30,334 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,334 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:30,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,335 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:30,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:30,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:30,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:30,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:30,335 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:30,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,337 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:30,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,340 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,340 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,340 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:30,340 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,340 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:30,340 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,340 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:30,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-26 15:53:30,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:30,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:30,340 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:30,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:30,341 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,341 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:30,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:30,341 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:30,341 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:30,441 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:30,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:30,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:30,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:30,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,453 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:30,453 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:30,454 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-26 15:53:30,454 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-26 15:53:30,454 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,455 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,456 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:30,456 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:30,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:30,457 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,457 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:30,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,457 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:30,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,458 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,458 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-26 15:53:30,458 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,458 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-26 15:53:30,458 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:30,459 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-26 15:53:30,459 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:30,459 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:30,459 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:30,459 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. started... 2023-11-26 15:53:30,459 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c250ec54ecf7a7b68d0c6e162cb264fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:30,880 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010322afc776e2ac459f93227a264d142d17 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010322afc776e2ac459f93227a264d142d17 2023-11-26 15:53:30,890 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/277ecfe9d3b44170887bf82c3db9f91b 2023-11-26 15:53:30,897 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/277ecfe9d3b44170887bf82c3db9f91b as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/277ecfe9d3b44170887bf82c3db9f91b 2023-11-26 15:53:30,904 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/277ecfe9d3b44170887bf82c3db9f91b, entries=1, sequenceid=33, filesize=5.0 K 2023-11-26 15:53:30,906 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c250ec54ecf7a7b68d0c6e162cb264fe in 447ms, sequenceid=33, compaction requested=true 2023-11-26 15:53:30,906 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c250ec54ecf7a7b68d0c6e162cb264fe: 2023-11-26 15:53:30,906 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:30,906 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:30,907 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:30,907 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,907 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-26 15:53:30,907 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-26 15:53:30,910 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,910 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:30,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:30,910 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,910 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:30,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:30,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:30,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:30,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-26 15:53:30,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@391753e4[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:30,912 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-26 15:53:30,912 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,914 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,914 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-26 15:53:30,914 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-26 15:53:30,914 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,914 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:30,914 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:30,916 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,916 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-26 15:53:30,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:30,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:30,916 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:30,916 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-26 15:53:30,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:30,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:30,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:30,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:30,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-26 15:53:30,920 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-26 15:53:30,920 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:30,920 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:30,920 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,920 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:30,922 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,922 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:30,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:30,923 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:30,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:30,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:30,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:30,923 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:30,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,926 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:30,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,930 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,931 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:30,931 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:30,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:30,931 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:30,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:30,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-26 15:53:30,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:30,931 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:30,931 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:30,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:30,932 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:30,932 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,932 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,932 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:30,932 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:30,932 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:31,032 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:31,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:31,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:31,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:31,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,044 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:31,044 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:31,044 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-26 15:53:31,044 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-26 15:53:31,045 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,045 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,047 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:31,047 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:31,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:31,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:31,047 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:31,047 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:31,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:31,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,048 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,049 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-26 15:53:31,050 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,050 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-26 15:53:31,050 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:31,050 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-26 15:53:31,050 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:31,050 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:31,050 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:31,050 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. started... 2023-11-26 15:53:31,051 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c250ec54ecf7a7b68d0c6e162cb264fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:31,069 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509075905a189dcca4929b57fca71af5cc9e7 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201509075905a189dcca4929b57fca71af5cc9e7 2023-11-26 15:53:31,478 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/ad7eb72c284041a7bf5841d5b1f0a19c 2023-11-26 15:53:31,486 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/ad7eb72c284041a7bf5841d5b1f0a19c as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/ad7eb72c284041a7bf5841d5b1f0a19c 2023-11-26 15:53:31,493 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/ad7eb72c284041a7bf5841d5b1f0a19c, entries=1, sequenceid=37, filesize=5.0 K 2023-11-26 15:53:31,494 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c250ec54ecf7a7b68d0c6e162cb264fe in 443ms, sequenceid=37, compaction requested=true 2023-11-26 15:53:31,494 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c250ec54ecf7a7b68d0c6e162cb264fe: 2023-11-26 15:53:31,494 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:31,495 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:31,495 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:31,495 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:31,495 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-26 15:53:31,495 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-26 15:53:31,497 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:31,497 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:31,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:31,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:31,498 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,498 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:31,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:31,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:31,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:31,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:31,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-26 15:53:31,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e4da749[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:31,500 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-26 15:53:31,500 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,501 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,502 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-26 15:53:31,502 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-26 15:53:31,502 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:31,502 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:31,502 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:31,504 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:31,504 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-26 15:53:31,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:31,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:31,505 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:31,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:31,505 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-26 15:53:31,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:31,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:31,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:31,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:31,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:31,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:31,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-26 15:53:31,509 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-26 15:53:31,509 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:31,509 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:31,509 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,509 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:31,511 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,511 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:31,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:31,511 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:31,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:31,512 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:31,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:31,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:31,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:31,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,514 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:31,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:31,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:31,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:31,520 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:31,520 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,521 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,521 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:31,521 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,521 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:31,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:31,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:31,521 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,521 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:31,521 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:31,521 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:31,521 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-26 15:53:31,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:31,522 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:31,522 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:31,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:31,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:31,622 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:31,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:31,632 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:31,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:31,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,634 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:31,634 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:31,635 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-26 15:53:31,635 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-26 15:53:31,635 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,635 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,638 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:31,638 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:31,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:31,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:31,639 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:31,639 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:31,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,639 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:31,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,640 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,640 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-26 15:53:31,640 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:31,640 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-26 15:53:31,640 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:31,642 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-26 15:53:31,642 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:31,642 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:31,642 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:31,642 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. started... 2023-11-26 15:53:31,642 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c250ec54ecf7a7b68d0c6e162cb264fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:32,063 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511207b655aaf59aa41e6aabef8ade9711683 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511207b655aaf59aa41e6aabef8ade9711683 2023-11-26 15:53:32,472 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/3a9451c78a9a417b84cd8755d5fa1239 2023-11-26 15:53:32,481 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/3a9451c78a9a417b84cd8755d5fa1239 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/3a9451c78a9a417b84cd8755d5fa1239 2023-11-26 15:53:32,488 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/3a9451c78a9a417b84cd8755d5fa1239, entries=1, sequenceid=41, filesize=5.0 K 2023-11-26 15:53:32,489 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c250ec54ecf7a7b68d0c6e162cb264fe in 847ms, sequenceid=41, compaction requested=true 2023-11-26 15:53:32,490 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c250ec54ecf7a7b68d0c6e162cb264fe: 2023-11-26 15:53:32,490 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:32,490 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:32,490 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:32,490 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:32,490 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-26 15:53:32,490 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-26 15:53:32,493 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:32,493 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:32,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:32,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:32,493 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,493 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:32,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:32,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-26 15:53:32,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5974bc2e[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:32,495 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-26 15:53:32,495 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,496 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,497 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-26 15:53:32,497 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-26 15:53:32,497 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:32,497 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:32,497 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:32,498 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:32,498 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-26 15:53:32,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:32,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:32,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:32,499 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:32,499 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-26 15:53:32,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:32,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:32,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:32,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:32,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:32,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:32,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-26 15:53:32,503 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-26 15:53:32,503 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:32,503 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:32,503 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,503 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:32,511 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,511 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,511 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:32,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:32,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:32,512 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:32,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:32,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:32,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:32,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:32,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,513 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:32,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:32,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:32,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:32,517 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:32,517 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,517 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:32,517 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:32,517 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:32,517 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:32,517 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,517 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:32,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:32,517 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-26 15:53:32,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-26 15:53:32,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:32,517 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,518 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:32,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:32,518 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:32,518 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:32,618 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:32,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:32,625 DEBUG [Listener at localhost/43645] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-26 15:53:32,627 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-26 15:53:32,629 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33415] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:32,642 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-26 15:53:32,643 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-26 15:53:32,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:53:32,644 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701014612644 2023-11-26 15:53:32,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-26 15:53:32,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-26 15:53:32,650 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-26 15:53:32,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] zookeeper.ReadOnlyZKClient(139): Connect 0x7620bb47 to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:53:32,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d276728, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:53:32,658 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-26 15:53:33,133 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b0eaafe4326b4b57a7f99135cef396d0 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b0eaafe4326b4b57a7f99135cef396d0 2023-11-26 15:53:33,135 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-26 15:53:33,154 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:53:33,156 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43676, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:53:33,169 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-26 15:53:33,170 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-26 15:53:33,211 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c9b577e0af0e407282603a25b202c5ae first=Optional[r3] last=Optional[r6] 2023-11-26 15:53:33,223 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c9b577e0af0e407282603a25b202c5ae}] 2023-11-26 15:53:33,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c9b577e0af0e407282603a25b202c5ae for inclusion in c250ec54ecf7a7b68d0c6e162cb264fe/family1 2023-11-26 15:53:33,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-26 15:53:33,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last= 2023-11-26 15:53:33,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for c250ec54ecf7a7b68d0c6e162cb264fe: 2023-11-26 15:53:33,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c9b577e0af0e407282603a25b202c5ae to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__q0vb8sp0ep6rs68blegkssc15damt0agm29nbburf7vmmq7kok4o7cru00qkak7s/family1/c9b577e0af0e407282603a25b202c5ae 2023-11-26 15:53:33,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__q0vb8sp0ep6rs68blegkssc15damt0agm29nbburf7vmmq7kok4o7cru00qkak7s/family1/c9b577e0af0e407282603a25b202c5ae as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/885c01fe51f940fb9b777e2a7c1b3ec9_SeqId_44_ 2023-11-26 15:53:33,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__q0vb8sp0ep6rs68blegkssc15damt0agm29nbburf7vmmq7kok4o7cru00qkak7s/family1/c9b577e0af0e407282603a25b202c5ae into c250ec54ecf7a7b68d0c6e162cb264fe/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/885c01fe51f940fb9b777e2a7c1b3ec9_SeqId_44_ - updating store file list. 2023-11-26 15:53:33,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/885c01fe51f940fb9b777e2a7c1b3ec9_SeqId_44_ into c250ec54ecf7a7b68d0c6e162cb264fe/family1 2023-11-26 15:53:33,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__q0vb8sp0ep6rs68blegkssc15damt0agm29nbburf7vmmq7kok4o7cru00qkak7s/family1/c9b577e0af0e407282603a25b202c5ae into c250ec54ecf7a7b68d0c6e162cb264fe/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/885c01fe51f940fb9b777e2a7c1b3ec9_SeqId_44_) 2023-11-26 15:53:33,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__q0vb8sp0ep6rs68blegkssc15damt0agm29nbburf7vmmq7kok4o7cru00qkak7s/family1/c9b577e0af0e407282603a25b202c5ae 2023-11-26 15:53:33,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-26 15:53:33,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-26 15:53:33,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(1912): c250ec54ecf7a7b68d0c6e162cb264fe/family1 is initiating minor compaction 2023-11-26 15:53:33,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@787a41dc; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:53:33,271 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c250ec54ecf7a7b68d0c6e162cb264fe/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:33,272 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/c5218bd445124f6186fbc565d19524b3, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/03540b5179544c4e8b95ee64852e54da, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/ea07e936e82c49548ffcd0c0162fee4a, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/bac4e58bddc14b54b02d9f5fcdb87f94, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/860e1c25e40448f59826916a9873c7fc, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/b37cac3cdb0c417ba120834550089e77, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/277ecfe9d3b44170887bf82c3db9f91b, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/ad7eb72c284041a7bf5841d5b1f0a19c, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/3a9451c78a9a417b84cd8755d5fa1239, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/885c01fe51f940fb9b777e2a7c1b3ec9_SeqId_44_] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp, totalSize=50.2 K 2023-11-26 15:53:33,273 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting c5218bd445124f6186fbc565d19524b3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-26 15:53:33,273 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 03540b5179544c4e8b95ee64852e54da, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-26 15:53:33,273 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting ea07e936e82c49548ffcd0c0162fee4a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-26 15:53:33,273 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting bac4e58bddc14b54b02d9f5fcdb87f94, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-26 15:53:33,273 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 860e1c25e40448f59826916a9873c7fc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-26 15:53:33,273 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting b37cac3cdb0c417ba120834550089e77, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-26 15:53:33,273 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 277ecfe9d3b44170887bf82c3db9f91b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-26 15:53:33,273 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting ad7eb72c284041a7bf5841d5b1f0a19c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-26 15:53:33,273 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 3a9451c78a9a417b84cd8755d5fa1239, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-26 15:53:33,273 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 885c01fe51f940fb9b777e2a7c1b3ec9_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-26 15:53:33,287 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-26 15:53:33,289 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:53:33,294 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228adfb2ca7c69b409d9944c665989268ef to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228adfb2ca7c69b409d9944c665989268ef 2023-11-26 15:53:33,296 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231f87d516d5c1a40379c6f22a25d20afc3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231f87d516d5c1a40379c6f22a25d20afc3 2023-11-26 15:53:33,298 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101cc8b589ee590456ba331faf63bfb48d2 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101cc8b589ee590456ba331faf63bfb48d2 2023-11-26 15:53:33,300 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010322afc776e2ac459f93227a264d142d17 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010322afc776e2ac459f93227a264d142d17 2023-11-26 15:53:33,300 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-11-26 15:53:33,300 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-26 15:53:33,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-26 15:53:33,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-26 15:53:33,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-26 15:53:33,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-26 15:53:33,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-26 15:53:33,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-26 15:53:33,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-26 15:53:33,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-26 15:53:33,337 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] throttle.PressureAwareThroughputController(145): c250ec54ecf7a7b68d0c6e162cb264fe#family1#compaction#10 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:53:33,769 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/42cc6d7848c44ef49c27bdc56f0fa8f4 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/42cc6d7848c44ef49c27bdc56f0fa8f4 2023-11-26 15:53:33,789 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in c250ec54ecf7a7b68d0c6e162cb264fe/family1 of c250ec54ecf7a7b68d0c6e162cb264fe into 42cc6d7848c44ef49c27bdc56f0fa8f4(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:53:33,789 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c250ec54ecf7a7b68d0c6e162cb264fe: 2023-11-26 15:53:33,791 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1701014013269; duration=0sec 2023-11-26 15:53:33,792 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:53:33,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/c5218bd445124f6186fbc565d19524b3, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/03540b5179544c4e8b95ee64852e54da, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/ea07e936e82c49548ffcd0c0162fee4a, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/bac4e58bddc14b54b02d9f5fcdb87f94, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/860e1c25e40448f59826916a9873c7fc, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/b37cac3cdb0c417ba120834550089e77, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/277ecfe9d3b44170887bf82c3db9f91b, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/ad7eb72c284041a7bf5841d5b1f0a19c, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/3a9451c78a9a417b84cd8755d5fa1239, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/885c01fe51f940fb9b777e2a7c1b3ec9_SeqId_44_] to archive 2023-11-26 15:53:33,828 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:53:33,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/c5218bd445124f6186fbc565d19524b3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/c5218bd445124f6186fbc565d19524b3 2023-11-26 15:53:33,832 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/03540b5179544c4e8b95ee64852e54da to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/03540b5179544c4e8b95ee64852e54da 2023-11-26 15:53:33,834 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/ea07e936e82c49548ffcd0c0162fee4a to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/ea07e936e82c49548ffcd0c0162fee4a 2023-11-26 15:53:33,836 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/bac4e58bddc14b54b02d9f5fcdb87f94 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/bac4e58bddc14b54b02d9f5fcdb87f94 2023-11-26 15:53:33,838 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/860e1c25e40448f59826916a9873c7fc to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/860e1c25e40448f59826916a9873c7fc 2023-11-26 15:53:33,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/b37cac3cdb0c417ba120834550089e77 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/b37cac3cdb0c417ba120834550089e77 2023-11-26 15:53:33,841 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/277ecfe9d3b44170887bf82c3db9f91b to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/277ecfe9d3b44170887bf82c3db9f91b 2023-11-26 15:53:33,843 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/ad7eb72c284041a7bf5841d5b1f0a19c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/ad7eb72c284041a7bf5841d5b1f0a19c 2023-11-26 15:53:33,844 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/3a9451c78a9a417b84cd8755d5fa1239 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/3a9451c78a9a417b84cd8755d5fa1239 2023-11-26 15:53:33,846 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/885c01fe51f940fb9b777e2a7c1b3ec9_SeqId_44_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/885c01fe51f940fb9b777e2a7c1b3ec9_SeqId_44_ 2023-11-26 15:53:34,209 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e4df2772e3ad4993ab07efa93295ae2d to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205e4df2772e3ad4993ab07efa93295ae2d 2023-11-26 15:53:34,210 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-26 15:53:34,239 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9d09e9ace73b49c3ae8ab76346540961 first=Optional[r00] last=Optional[r2] 2023-11-26 15:53:34,240 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9d09e9ace73b49c3ae8ab76346540961}] 2023-11-26 15:53:34,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9d09e9ace73b49c3ae8ab76346540961 for inclusion in c250ec54ecf7a7b68d0c6e162cb264fe/family1 2023-11-26 15:53:34,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-26 15:53:34,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last= 2023-11-26 15:53:34,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for c250ec54ecf7a7b68d0c6e162cb264fe: 2023-11-26 15:53:34,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9d09e9ace73b49c3ae8ab76346540961 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__3aa7pm62oq1jb6mlu2k7gt97q925a58m7nanmuulosj1gjklhuftbi3lp9aug918/family1/9d09e9ace73b49c3ae8ab76346540961 2023-11-26 15:53:34,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__3aa7pm62oq1jb6mlu2k7gt97q925a58m7nanmuulosj1gjklhuftbi3lp9aug918/family1/9d09e9ace73b49c3ae8ab76346540961 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/03e4375eeb8f4f9982defaf2e1a6a5ac_SeqId_47_ 2023-11-26 15:53:34,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__3aa7pm62oq1jb6mlu2k7gt97q925a58m7nanmuulosj1gjklhuftbi3lp9aug918/family1/9d09e9ace73b49c3ae8ab76346540961 into c250ec54ecf7a7b68d0c6e162cb264fe/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/03e4375eeb8f4f9982defaf2e1a6a5ac_SeqId_47_ - updating store file list. 2023-11-26 15:53:34,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/03e4375eeb8f4f9982defaf2e1a6a5ac_SeqId_47_ into c250ec54ecf7a7b68d0c6e162cb264fe/family1 2023-11-26 15:53:34,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__3aa7pm62oq1jb6mlu2k7gt97q925a58m7nanmuulosj1gjklhuftbi3lp9aug918/family1/9d09e9ace73b49c3ae8ab76346540961 into c250ec54ecf7a7b68d0c6e162cb264fe/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/03e4375eeb8f4f9982defaf2e1a6a5ac_SeqId_47_) 2023-11-26 15:53:34,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__3aa7pm62oq1jb6mlu2k7gt97q925a58m7nanmuulosj1gjklhuftbi3lp9aug918/family1/9d09e9ace73b49c3ae8ab76346540961 2023-11-26 15:53:34,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-26 15:53:34,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-26 15:53:34,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(1912): c250ec54ecf7a7b68d0c6e162cb264fe/family1 is initiating minor compaction (all files) 2023-11-26 15:53:34,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2db946d7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:53:34,260 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c250ec54ecf7a7b68d0c6e162cb264fe/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:34,260 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/a4297a89234249d7b39fa1243f4a3aaa, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/42cc6d7848c44ef49c27bdc56f0fa8f4, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/03e4375eeb8f4f9982defaf2e1a6a5ac_SeqId_47_] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp, totalSize=358.6 K 2023-11-26 15:53:34,261 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting a4297a89234249d7b39fa1243f4a3aaa, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823935 2023-11-26 15:53:34,262 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 42cc6d7848c44ef49c27bdc56f0fa8f4, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223935 2023-11-26 15:53:34,263 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 03e4375eeb8f4f9982defaf2e1a6a5ac_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878823935 2023-11-26 15:53:34,263 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-26 15:53:34,264 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:53:34,266 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130e0b696b008bb496caa5e0047b43d7133 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130e0b696b008bb496caa5e0047b43d7133 2023-11-26 15:53:34,268 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201f69bd30e0b4f433e913e9c17c8113a11 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201f69bd30e0b4f433e913e9c17c8113a11 2023-11-26 15:53:34,270 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205f5cbdbe6f89b4e8291df5e2a693336be to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205f5cbdbe6f89b4e8291df5e2a693336be 2023-11-26 15:53:34,270 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-11-26 15:53:34,270 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-26 15:53:34,271 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-26 15:53:34,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-26 15:53:34,272 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:53:34,272 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-26 15:53:34,274 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.6380 sec 2023-11-26 15:53:34,316 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] throttle.PressureAwareThroughputController(145): c250ec54ecf7a7b68d0c6e162cb264fe#family1#compaction#11 average throughput is 4.24 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:53:34,368 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/.tmp/family1/065fe79033a94c4da206f262fb4d379a as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/065fe79033a94c4da206f262fb4d379a 2023-11-26 15:53:34,379 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in c250ec54ecf7a7b68d0c6e162cb264fe/family1 of c250ec54ecf7a7b68d0c6e162cb264fe into 065fe79033a94c4da206f262fb4d379a(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:53:34,379 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c250ec54ecf7a7b68d0c6e162cb264fe: 2023-11-26 15:53:34,379 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1701014014260; duration=0sec 2023-11-26 15:53:34,379 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:53:34,427 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/a4297a89234249d7b39fa1243f4a3aaa, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/42cc6d7848c44ef49c27bdc56f0fa8f4, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/03e4375eeb8f4f9982defaf2e1a6a5ac_SeqId_47_] to archive 2023-11-26 15:53:34,428 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:53:34,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/a4297a89234249d7b39fa1243f4a3aaa to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/a4297a89234249d7b39fa1243f4a3aaa 2023-11-26 15:53:34,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/42cc6d7848c44ef49c27bdc56f0fa8f4 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/42cc6d7848c44ef49c27bdc56f0fa8f4 2023-11-26 15:53:34,436 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/03e4375eeb8f4f9982defaf2e1a6a5ac_SeqId_47_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/03e4375eeb8f4f9982defaf2e1a6a5ac_SeqId_47_ 2023-11-26 15:53:34,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-26 15:53:34,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:34,490 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-26 15:53:34,493 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-26 15:53:34,493 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-26 15:53:34,498 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-11-26 15:53:34,515 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c250ec54ecf7a7b68d0c6e162cb264fe, REOPEN/MOVE}] 2023-11-26 15:53:34,516 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c250ec54ecf7a7b68d0c6e162cb264fe, REOPEN/MOVE 2023-11-26 15:53:34,517 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c250ec54ecf7a7b68d0c6e162cb264fe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:34,517 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701014014517"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014014517"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014014517"}]},"ts":"1701014014517"} 2023-11-26 15:53:34,520 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure c250ec54ecf7a7b68d0c6e162cb264fe, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:53:34,677 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:34,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c250ec54ecf7a7b68d0c6e162cb264fe 2023-11-26 15:53:34,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c250ec54ecf7a7b68d0c6e162cb264fe, disabling compactions & flushes 2023-11-26 15:53:34,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:34,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:34,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. after waiting 0 ms 2023-11-26 15:53:34,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:34,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-26 15:53:34,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:34,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c250ec54ecf7a7b68d0c6e162cb264fe: 2023-11-26 15:53:34,688 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: c250ec54ecf7a7b68d0c6e162cb264fe to self. 2023-11-26 15:53:34,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c250ec54ecf7a7b68d0c6e162cb264fe 2023-11-26 15:53:34,691 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c250ec54ecf7a7b68d0c6e162cb264fe, regionState=CLOSED 2023-11-26 15:53:34,691 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701014014691"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014014691"}]},"ts":"1701014014691"} 2023-11-26 15:53:34,696 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=16, resume processing ppid=15 2023-11-26 15:53:34,697 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c250ec54ecf7a7b68d0c6e162cb264fe, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=true 2023-11-26 15:53:34,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure c250ec54ecf7a7b68d0c6e162cb264fe, server=jenkins-hbase4.apache.org,41861,1701014000937 in 173 msec 2023-11-26 15:53:34,847 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c250ec54ecf7a7b68d0c6e162cb264fe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:34,847 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701014014847"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014014847"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014014847"}]},"ts":"1701014014847"} 2023-11-26 15:53:34,850 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure c250ec54ecf7a7b68d0c6e162cb264fe, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:53:35,003 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:35,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:35,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c250ec54ecf7a7b68d0c6e162cb264fe, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe.', STARTKEY => '', ENDKEY => ''} 2023-11-26 15:53:35,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly c250ec54ecf7a7b68d0c6e162cb264fe 2023-11-26 15:53:35,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:53:35,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c250ec54ecf7a7b68d0c6e162cb264fe 2023-11-26 15:53:35,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c250ec54ecf7a7b68d0c6e162cb264fe 2023-11-26 15:53:35,009 INFO [StoreOpener-c250ec54ecf7a7b68d0c6e162cb264fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c250ec54ecf7a7b68d0c6e162cb264fe 2023-11-26 15:53:35,010 DEBUG [StoreOpener-c250ec54ecf7a7b68d0c6e162cb264fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1 2023-11-26 15:53:35,010 DEBUG [StoreOpener-c250ec54ecf7a7b68d0c6e162cb264fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1 2023-11-26 15:53:35,010 INFO [StoreOpener-c250ec54ecf7a7b68d0c6e162cb264fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c250ec54ecf7a7b68d0c6e162cb264fe columnFamilyName family1 2023-11-26 15:53:35,018 DEBUG [StoreOpener-c250ec54ecf7a7b68d0c6e162cb264fe-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/065fe79033a94c4da206f262fb4d379a 2023-11-26 15:53:35,019 INFO [StoreOpener-c250ec54ecf7a7b68d0c6e162cb264fe-1] regionserver.HStore(310): Store=c250ec54ecf7a7b68d0c6e162cb264fe/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:53:35,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe 2023-11-26 15:53:35,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe 2023-11-26 15:53:35,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c250ec54ecf7a7b68d0c6e162cb264fe 2023-11-26 15:53:35,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c250ec54ecf7a7b68d0c6e162cb264fe; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61060999, jitterRate=-0.09012021124362946}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-26 15:53:35,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c250ec54ecf7a7b68d0c6e162cb264fe: 2023-11-26 15:53:35,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe., pid=17, masterSystemTime=1701014015003 2023-11-26 15:53:35,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:35,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:53:35,029 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=c250ec54ecf7a7b68d0c6e162cb264fe, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:35,029 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701014015029"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014015029"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014015029"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014015029"}]},"ts":"1701014015029"} 2023-11-26 15:53:35,033 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=17, resume processing ppid=15 2023-11-26 15:53:35,034 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure c250ec54ecf7a7b68d0c6e162cb264fe, server=jenkins-hbase4.apache.org,41861,1701014000937 in 181 msec 2023-11-26 15:53:35,036 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=15, resume processing ppid=14 2023-11-26 15:53:35,036 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=c250ec54ecf7a7b68d0c6e162cb264fe, REOPEN/MOVE in 519 msec 2023-11-26 15:53:35,039 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=14, resume processing ppid=13 2023-11-26 15:53:35,039 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 541 msec 2023-11-26 15:53:35,042 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 572 msec 2023-11-26 15:53:35,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-11-26 15:53:35,053 INFO [Listener at localhost/43645] compactions.TestMobCompactor(278): alter status finished 2023-11-26 15:53:35,054 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33415] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-26 15:53:35,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-26 15:53:35,057 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-26 15:53:35,058 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701014615058 2023-11-26 15:53:35,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:53:35,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-26 15:53:35,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-26 15:53:35,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-26 15:53:35,062 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] zookeeper.ReadOnlyZKClient(139): Connect 0x611bfd54 to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:53:35,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2643c25, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:53:35,072 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-26 15:53:35,072 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-26 15:53:35,072 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-26 15:53:35,073 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-26 15:53:35,073 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-26 15:53:35,913 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c347ee19811748e28b66770e1ee59d1d to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128c347ee19811748e28b66770e1ee59d1d 2023-11-26 15:53:35,914 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-26 15:53:35,931 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:53:35,932 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43682, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:53:35,941 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-26 15:53:35,944 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57954, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-26 15:53:35,956 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f06035bf14bd4eb5ba76f12663da006f first=Optional[r05] last=Optional[r8] 2023-11-26 15:53:35,957 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=51 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f06035bf14bd4eb5ba76f12663da006f}] 2023-11-26 15:53:35,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f06035bf14bd4eb5ba76f12663da006f for inclusion in c250ec54ecf7a7b68d0c6e162cb264fe/family1 2023-11-26 15:53:35,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-26 15:53:35,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last= 2023-11-26 15:53:35,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for c250ec54ecf7a7b68d0c6e162cb264fe: 2023-11-26 15:53:35,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f06035bf14bd4eb5ba76f12663da006f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__r8dovjtrtb830ec7erdl6b1h1fcauqgvu3km6g975l7ktjassd4ind30jgn2rqve/family1/f06035bf14bd4eb5ba76f12663da006f 2023-11-26 15:53:35,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__r8dovjtrtb830ec7erdl6b1h1fcauqgvu3km6g975l7ktjassd4ind30jgn2rqve/family1/f06035bf14bd4eb5ba76f12663da006f as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/ff91458dd277479fbeea606a2620ec88_SeqId_53_ 2023-11-26 15:53:35,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__r8dovjtrtb830ec7erdl6b1h1fcauqgvu3km6g975l7ktjassd4ind30jgn2rqve/family1/f06035bf14bd4eb5ba76f12663da006f into c250ec54ecf7a7b68d0c6e162cb264fe/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/ff91458dd277479fbeea606a2620ec88_SeqId_53_ - updating store file list. 2023-11-26 15:53:35,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/ff91458dd277479fbeea606a2620ec88_SeqId_53_ into c250ec54ecf7a7b68d0c6e162cb264fe/family1 2023-11-26 15:53:35,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__r8dovjtrtb830ec7erdl6b1h1fcauqgvu3km6g975l7ktjassd4ind30jgn2rqve/family1/f06035bf14bd4eb5ba76f12663da006f into c250ec54ecf7a7b68d0c6e162cb264fe/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/family1/ff91458dd277479fbeea606a2620ec88_SeqId_53_) 2023-11-26 15:53:35,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__r8dovjtrtb830ec7erdl6b1h1fcauqgvu3km6g975l7ktjassd4ind30jgn2rqve/family1/f06035bf14bd4eb5ba76f12663da006f 2023-11-26 15:53:35,982 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-26 15:53:35,984 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:53:35,986 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511207b655aaf59aa41e6aabef8ade9711683 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511207b655aaf59aa41e6aabef8ade9711683 2023-11-26 15:53:35,987 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128ebbd29f776af45e98c9cd73721abd1a4 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128ebbd29f776af45e98c9cd73721abd1a4 2023-11-26 15:53:35,987 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-11-26 15:53:35,987 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-26 15:53:35,988 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-26 15:53:35,988 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-26 15:53:35,988 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-26 15:53:35,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-26 15:53:35,988 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:53:35,989 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-26 15:53:35,991 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 934 msec 2023-11-26 15:53:36,076 INFO [Listener at localhost/43645] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=254 (was 214) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7e998011-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b4b6842-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58210@0x611bfd54-SendThread(127.0.0.1:58210) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:47632 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58210@0x7620bb47 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/3377090.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:47582 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:45072 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:45140 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58210@0x7620bb47-SendThread(127.0.0.1:58210) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:45082 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7e998011-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:45168 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:45078 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:45180 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:45126 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:47552 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58210@0x7620bb47-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:45130 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:45132 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58210@0x611bfd54 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/3377090.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b4b6842-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6b4b6842-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7e998011-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7e998011-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7e998011-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:45188 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2040784163_17 at /127.0.0.1:45098 [Waiting for operation #24] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:47616 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58210@0x611bfd54-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: RS:0;jenkins-hbase4:41861-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:45220 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=626 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=323 (was 386), ProcessCount=172 (was 172), AvailableMemoryMB=8560 (was 8571) 2023-11-26 15:53:36,089 INFO [Listener at localhost/43645] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=254, OpenFileDescriptor=626, MaxFileDescriptor=60000, SystemLoadAverage=323, ProcessCount=172, AvailableMemoryMB=8559 2023-11-26 15:53:36,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-26 15:53:36,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:36,096 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-26 15:53:36,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-11-26 15:53:36,097 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-26 15:53:36,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-26 15:53:36,099 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9 2023-11-26 15:53:36,099 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9 empty. 2023-11-26 15:53:36,100 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9 2023-11-26 15:53:36,100 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-11-26 15:53:36,112 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-26 15:53:36,114 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8929c83bb706f599f3d8e0a34ab792c9, NAME => 'testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:53:36,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-26 15:53:36,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-26 15:53:36,521 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:53:36,522 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 8929c83bb706f599f3d8e0a34ab792c9, disabling compactions & flushes 2023-11-26 15:53:36,522 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:36,522 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:36,522 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. after waiting 0 ms 2023-11-26 15:53:36,522 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:36,522 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:36,522 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 8929c83bb706f599f3d8e0a34ab792c9: 2023-11-26 15:53:36,525 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-26 15:53:36,526 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701014016526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014016526"}]},"ts":"1701014016526"} 2023-11-26 15:53:36,528 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-26 15:53:36,529 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-26 15:53:36,529 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014016529"}]},"ts":"1701014016529"} 2023-11-26 15:53:36,531 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-26 15:53:36,534 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=8929c83bb706f599f3d8e0a34ab792c9, ASSIGN}] 2023-11-26 15:53:36,536 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=8929c83bb706f599f3d8e0a34ab792c9, ASSIGN 2023-11-26 15:53:36,537 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=8929c83bb706f599f3d8e0a34ab792c9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:53:36,688 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=8929c83bb706f599f3d8e0a34ab792c9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:36,688 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701014016687"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014016687"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014016687"}]},"ts":"1701014016687"} 2023-11-26 15:53:36,690 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 8929c83bb706f599f3d8e0a34ab792c9, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:53:36,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-26 15:53:36,842 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:36,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:36,846 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8929c83bb706f599f3d8e0a34ab792c9, NAME => 'testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9.', STARTKEY => '', ENDKEY => ''} 2023-11-26 15:53:36,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 8929c83bb706f599f3d8e0a34ab792c9 2023-11-26 15:53:36,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:53:36,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8929c83bb706f599f3d8e0a34ab792c9 2023-11-26 15:53:36,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8929c83bb706f599f3d8e0a34ab792c9 2023-11-26 15:53:36,849 INFO [StoreOpener-8929c83bb706f599f3d8e0a34ab792c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8929c83bb706f599f3d8e0a34ab792c9 2023-11-26 15:53:36,850 DEBUG [StoreOpener-8929c83bb706f599f3d8e0a34ab792c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1 2023-11-26 15:53:36,850 DEBUG [StoreOpener-8929c83bb706f599f3d8e0a34ab792c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1 2023-11-26 15:53:36,851 INFO [StoreOpener-8929c83bb706f599f3d8e0a34ab792c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8929c83bb706f599f3d8e0a34ab792c9 columnFamilyName family1 2023-11-26 15:53:36,852 INFO [StoreOpener-8929c83bb706f599f3d8e0a34ab792c9-1] regionserver.HStore(310): Store=8929c83bb706f599f3d8e0a34ab792c9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:53:36,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9 2023-11-26 15:53:36,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9 2023-11-26 15:53:36,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8929c83bb706f599f3d8e0a34ab792c9 2023-11-26 15:53:36,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:53:36,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8929c83bb706f599f3d8e0a34ab792c9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65088661, jitterRate=-0.030103370547294617}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-26 15:53:36,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8929c83bb706f599f3d8e0a34ab792c9: 2023-11-26 15:53:36,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9., pid=21, masterSystemTime=1701014016842 2023-11-26 15:53:36,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:36,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:36,864 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=8929c83bb706f599f3d8e0a34ab792c9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:36,864 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701014016864"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014016864"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014016864"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014016864"}]},"ts":"1701014016864"} 2023-11-26 15:53:36,868 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=21, resume processing ppid=20 2023-11-26 15:53:36,868 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 8929c83bb706f599f3d8e0a34ab792c9, server=jenkins-hbase4.apache.org,41861,1701014000937 in 176 msec 2023-11-26 15:53:36,870 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=20, resume processing ppid=19 2023-11-26 15:53:36,870 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=8929c83bb706f599f3d8e0a34ab792c9, ASSIGN in 334 msec 2023-11-26 15:53:36,871 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-26 15:53:36,871 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014016871"}]},"ts":"1701014016871"} 2023-11-26 15:53:36,872 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-26 15:53:36,875 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-26 15:53:36,877 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 783 msec 2023-11-26 15:53:37,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-26 15:53:37,202 INFO [Listener at localhost/43645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-11-26 15:53:37,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:37,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:37,244 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:37,244 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:37,244 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-26 15:53:37,244 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-26 15:53:37,245 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:37,245 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:37,247 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:37,247 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:37,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:37,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:37,247 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:37,247 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:37,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:37,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:37,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:37,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:37,248 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:37,248 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:37,249 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-26 15:53:37,249 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:37,249 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-26 15:53:37,249 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:37,250 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:37,250 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:37,250 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. started... 2023-11-26 15:53:37,250 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8929c83bb706f599f3d8e0a34ab792c9 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-26 15:53:37,681 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511303ae4c17de66a42e58f9ce5ae3724f360 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511303ae4c17de66a42e58f9ce5ae3724f360 2023-11-26 15:53:38,086 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/43883dafb95d4eecb68d7042b8a65f3f 2023-11-26 15:53:38,092 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/43883dafb95d4eecb68d7042b8a65f3f as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/43883dafb95d4eecb68d7042b8a65f3f 2023-11-26 15:53:38,098 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/43883dafb95d4eecb68d7042b8a65f3f, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-26 15:53:38,099 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 8929c83bb706f599f3d8e0a34ab792c9 in 849ms, sequenceid=5, compaction requested=false 2023-11-26 15:53:38,099 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:38,100 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8929c83bb706f599f3d8e0a34ab792c9: 2023-11-26 15:53:38,100 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:38,100 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:38,100 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:38,100 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:38,100 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-26 15:53:38,100 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-26 15:53:38,102 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:38,102 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:38,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:38,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:38,103 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,103 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:38,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:38,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:38,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:38,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:38,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-26 15:53:38,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ce19cc[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:38,105 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-26 15:53:38,105 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,107 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,107 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-26 15:53:38,107 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-26 15:53:38,107 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:38,107 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:38,107 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:38,109 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:38,109 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-26 15:53:38,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:38,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:38,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:38,109 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:38,109 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-26 15:53:38,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:38,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:38,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:38,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:38,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:38,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:38,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:53:38,113 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-26 15:53:38,113 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:38,113 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:38,113 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,113 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:38,115 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,115 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:38,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:38,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,115 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:38,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:38,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:38,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:38,116 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:38,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:38,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:38,118 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:38,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:38,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:38,124 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:38,124 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,124 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:38,124 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:38,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:38,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:38,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:38,124 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:38,124 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:38,124 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:38,125 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,125 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:38,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:38,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:38,126 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,126 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:38,126 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,226 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:38,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:38,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:38,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:38,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,235 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:38,235 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:38,235 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-26 15:53:38,236 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-26 15:53:38,236 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,236 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,238 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:38,238 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:38,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:38,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:38,239 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:38,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,239 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:38,239 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:38,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,240 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,240 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-26 15:53:38,240 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:38,240 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-26 15:53:38,240 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:38,240 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-26 15:53:38,241 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:38,241 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:38,241 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:38,241 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. started... 2023-11-26 15:53:38,241 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8929c83bb706f599f3d8e0a34ab792c9 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-26 15:53:38,657 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b9a7bda109b7440ab9ac5e707ed2487c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128b9a7bda109b7440ab9ac5e707ed2487c 2023-11-26 15:53:39,064 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/52c8b3a66af049d092f80d15fdc5640b 2023-11-26 15:53:39,071 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/52c8b3a66af049d092f80d15fdc5640b as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/52c8b3a66af049d092f80d15fdc5640b 2023-11-26 15:53:39,077 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/52c8b3a66af049d092f80d15fdc5640b, entries=1, sequenceid=9, filesize=5.0 K 2023-11-26 15:53:39,079 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 8929c83bb706f599f3d8e0a34ab792c9 in 838ms, sequenceid=9, compaction requested=false 2023-11-26 15:53:39,079 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8929c83bb706f599f3d8e0a34ab792c9: 2023-11-26 15:53:39,079 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:39,079 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:39,079 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:39,079 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,079 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-26 15:53:39,079 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-26 15:53:39,081 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,081 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:39,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:39,081 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,081 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:39,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:39,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:39,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:39,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-26 15:53:39,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c5f2e2[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:39,083 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-26 15:53:39,084 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,085 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,085 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-26 15:53:39,085 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-26 15:53:39,085 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:39,085 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,085 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:39,086 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-26 15:53:39,086 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,086 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:39,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:39,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:39,086 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-26 15:53:39,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:39,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:39,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:39,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:39,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:53:39,090 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-26 15:53:39,090 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:39,090 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:39,090 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,090 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:39,093 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,093 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:39,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:39,094 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:39,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:39,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:39,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:39,094 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,096 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:39,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:39,099 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,099 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,099 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:39,099 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:39,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:39,100 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,100 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,100 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:39,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:39,100 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:39,100 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:39,100 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:39,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:39,101 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:39,101 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:39,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-26 15:53:39,201 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:39,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:39,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:39,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:39,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,210 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:39,210 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:39,211 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-26 15:53:39,211 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-26 15:53:39,211 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,211 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,213 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:39,213 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:39,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:39,213 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,213 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:39,214 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:39,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,214 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,215 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-26 15:53:39,215 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,215 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-26 15:53:39,215 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:39,215 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-26 15:53:39,216 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:39,216 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:39,216 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:39,216 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. started... 2023-11-26 15:53:39,216 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8929c83bb706f599f3d8e0a34ab792c9 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:39,236 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201628c8dab7d15423b8b7d793684b4b685 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201628c8dab7d15423b8b7d793684b4b685 2023-11-26 15:53:39,242 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/346cff976da54acca2b770287ae5d7cb 2023-11-26 15:53:39,249 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/346cff976da54acca2b770287ae5d7cb as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/346cff976da54acca2b770287ae5d7cb 2023-11-26 15:53:39,254 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/346cff976da54acca2b770287ae5d7cb, entries=1, sequenceid=13, filesize=4.9 K 2023-11-26 15:53:39,255 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8929c83bb706f599f3d8e0a34ab792c9 in 39ms, sequenceid=13, compaction requested=true 2023-11-26 15:53:39,255 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8929c83bb706f599f3d8e0a34ab792c9: 2023-11-26 15:53:39,255 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:39,255 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:39,255 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:39,255 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,255 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-26 15:53:39,255 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-26 15:53:39,257 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,257 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:39,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:39,258 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,258 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:39,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:39,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:39,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:39,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-26 15:53:39,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45f16a9c[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:39,260 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-26 15:53:39,260 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,261 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,262 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-26 15:53:39,262 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-26 15:53:39,262 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:39,262 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,262 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:39,263 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-26 15:53:39,263 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:39,263 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,263 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-26 15:53:39,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:39,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:39,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:39,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:39,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:39,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:39,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:53:39,266 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-26 15:53:39,266 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:39,266 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:39,267 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,267 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:39,269 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,269 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:39,269 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:39,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:39,269 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:39,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,271 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:39,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,274 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,274 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:39,274 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:39,274 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:39,274 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,274 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:39,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:39,274 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:39,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:39,275 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,275 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,275 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:39,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:39,275 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:39,275 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:39,375 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:39,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:39,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:39,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:39,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,384 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:39,384 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:39,384 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-26 15:53:39,384 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-26 15:53:39,385 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,385 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,387 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,387 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:39,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:39,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:39,387 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:39,388 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:39,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:39,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,388 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,389 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-26 15:53:39,389 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:39,389 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-26 15:53:39,389 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:39,389 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-26 15:53:39,389 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:39,389 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:39,390 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:39,390 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. started... 2023-11-26 15:53:39,390 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8929c83bb706f599f3d8e0a34ab792c9 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:39,806 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120571dbe58f23b043be8adad5ff1a2ad14c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120571dbe58f23b043be8adad5ff1a2ad14c 2023-11-26 15:53:40,213 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/2ed8543e2fba48b6b8421e43937f4ccc 2023-11-26 15:53:40,214 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-26 15:53:40,221 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/2ed8543e2fba48b6b8421e43937f4ccc as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/2ed8543e2fba48b6b8421e43937f4ccc 2023-11-26 15:53:40,227 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/2ed8543e2fba48b6b8421e43937f4ccc, entries=1, sequenceid=17, filesize=4.9 K 2023-11-26 15:53:40,229 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8929c83bb706f599f3d8e0a34ab792c9 in 839ms, sequenceid=17, compaction requested=true 2023-11-26 15:53:40,229 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8929c83bb706f599f3d8e0a34ab792c9: 2023-11-26 15:53:40,229 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:40,229 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:40,229 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:40,229 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,229 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-26 15:53:40,229 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-26 15:53:40,231 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,231 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:40,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:40,231 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,231 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:40,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:40,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:40,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:40,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-26 15:53:40,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39983bc0[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:40,233 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-26 15:53:40,233 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,235 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,235 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-26 15:53:40,235 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-26 15:53:40,235 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:40,235 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,235 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:40,244 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-26 15:53:40,244 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,244 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:40,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:40,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:40,245 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-26 15:53:40,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:40,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:40,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:40,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:40,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:53:40,248 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-26 15:53:40,248 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:40,248 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:40,248 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,248 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:40,250 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,250 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:40,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:40,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,250 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:40,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:40,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:40,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:40,251 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:40,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,253 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:40,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,256 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:40,256 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,256 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:40,256 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:40,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:40,256 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:40,256 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-26 15:53:40,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:40,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:40,257 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,257 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:40,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:40,257 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,257 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,257 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:40,258 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:40,358 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:40,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:40,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:40,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:40,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,365 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:40,365 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:40,366 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-26 15:53:40,366 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-26 15:53:40,366 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,366 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,368 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,368 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:40,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:40,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:40,368 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,368 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:40,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,369 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:40,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,369 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,370 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-26 15:53:40,370 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,370 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-26 15:53:40,370 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:40,372 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-26 15:53:40,372 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:40,372 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:40,372 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:40,372 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. started... 2023-11-26 15:53:40,373 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8929c83bb706f599f3d8e0a34ab792c9 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:40,789 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285e84c691010b4c18bf9967633314d404 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512285e84c691010b4c18bf9967633314d404 2023-11-26 15:53:40,795 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/4c2d220008514bab92261f073953d289 2023-11-26 15:53:40,800 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/4c2d220008514bab92261f073953d289 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/4c2d220008514bab92261f073953d289 2023-11-26 15:53:40,805 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/4c2d220008514bab92261f073953d289, entries=1, sequenceid=21, filesize=4.9 K 2023-11-26 15:53:40,806 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8929c83bb706f599f3d8e0a34ab792c9 in 433ms, sequenceid=21, compaction requested=true 2023-11-26 15:53:40,806 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8929c83bb706f599f3d8e0a34ab792c9: 2023-11-26 15:53:40,806 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:40,806 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:40,806 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:40,806 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,806 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-26 15:53:40,806 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-26 15:53:40,809 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,809 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:40,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:40,810 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,810 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:40,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:40,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:40,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:40,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-26 15:53:40,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c6d5546[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:40,811 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-26 15:53:40,812 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,813 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,813 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-26 15:53:40,813 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-26 15:53:40,813 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,813 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:40,813 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:40,815 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,815 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-26 15:53:40,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:40,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:40,815 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:40,815 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-26 15:53:40,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:40,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:40,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:40,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:40,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:53:40,819 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-26 15:53:40,819 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:40,819 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:40,819 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,819 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:40,822 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,822 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:40,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:40,822 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:40,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:40,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:40,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:40,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,823 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:40,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,825 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:40,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,829 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,829 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:40,829 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,829 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,829 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:40,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:40,829 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,829 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:40,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:40,830 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:40,830 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:40,830 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,830 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:40,830 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:40,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:40,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:40,930 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:40,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:40,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:40,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:40,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,939 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:40,939 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:40,939 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-26 15:53:40,939 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-26 15:53:40,940 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,940 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,942 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:40,942 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:40,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:40,942 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:40,942 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:40,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,943 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:40,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,943 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,944 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-26 15:53:40,944 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:40,944 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-26 15:53:40,944 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:40,944 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-26 15:53:40,945 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:40,945 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:40,945 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:40,945 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. started... 2023-11-26 15:53:40,945 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8929c83bb706f599f3d8e0a34ab792c9 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:41,361 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512312ce20db515d0489fbda1154ef7a471e8 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512312ce20db515d0489fbda1154ef7a471e8 2023-11-26 15:53:41,767 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/abf36698250842a59273af446240343c 2023-11-26 15:53:41,774 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/abf36698250842a59273af446240343c as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/abf36698250842a59273af446240343c 2023-11-26 15:53:41,780 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/abf36698250842a59273af446240343c, entries=1, sequenceid=25, filesize=4.9 K 2023-11-26 15:53:41,781 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8929c83bb706f599f3d8e0a34ab792c9 in 836ms, sequenceid=25, compaction requested=true 2023-11-26 15:53:41,781 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8929c83bb706f599f3d8e0a34ab792c9: 2023-11-26 15:53:41,781 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:41,781 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:41,781 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:41,781 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:41,781 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-26 15:53:41,781 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-26 15:53:41,783 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:41,783 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:41,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:41,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:41,784 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,784 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:41,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:41,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:41,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:41,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:41,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-26 15:53:41,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6516eccb[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:41,785 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-26 15:53:41,785 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,787 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,787 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-26 15:53:41,787 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-26 15:53:41,787 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:41,787 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:41,787 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:41,790 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:41,790 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-26 15:53:41,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:41,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:41,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:41,790 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:41,790 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-26 15:53:41,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:41,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:41,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:41,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:41,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:41,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:41,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:53:41,793 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-26 15:53:41,794 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:41,794 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:41,794 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,794 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:41,795 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,795 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:41,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:41,795 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:41,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,796 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:41,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:41,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:41,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:41,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,797 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:41,800 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:41,800 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,800 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:41,800 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:41,800 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:41,800 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:41,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:41,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:41,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:41,800 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:41,801 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,801 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,801 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,801 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:41,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:41,801 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:41,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:41,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:41,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:41,802 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-26 15:53:41,902 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:41,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:41,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:41,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:41,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,910 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:41,910 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:41,911 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-26 15:53:41,911 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-26 15:53:41,912 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,912 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,913 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:41,913 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:41,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:41,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:41,914 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:41,914 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:41,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:41,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,915 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,915 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-26 15:53:41,915 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:41,915 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-26 15:53:41,915 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:41,916 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-26 15:53:41,916 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:41,916 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:41,916 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:41,916 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. started... 2023-11-26 15:53:41,916 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8929c83bb706f599f3d8e0a34ab792c9 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:42,338 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101d9ff02097df843daa679efd9616c8432 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101d9ff02097df843daa679efd9616c8432 2023-11-26 15:53:42,744 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/b2bfb0b8f36b43d0ab69d241ea9af199 2023-11-26 15:53:42,750 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/b2bfb0b8f36b43d0ab69d241ea9af199 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/b2bfb0b8f36b43d0ab69d241ea9af199 2023-11-26 15:53:42,756 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/b2bfb0b8f36b43d0ab69d241ea9af199, entries=1, sequenceid=29, filesize=4.9 K 2023-11-26 15:53:42,757 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8929c83bb706f599f3d8e0a34ab792c9 in 841ms, sequenceid=29, compaction requested=true 2023-11-26 15:53:42,757 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8929c83bb706f599f3d8e0a34ab792c9: 2023-11-26 15:53:42,757 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:42,757 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:42,757 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:42,757 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:42,757 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-26 15:53:42,757 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-26 15:53:42,765 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:42,765 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:42,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:42,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:42,766 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,766 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:42,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:42,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:42,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:42,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:42,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-26 15:53:42,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b7dcf7f[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:42,767 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-26 15:53:42,767 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,769 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,769 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-26 15:53:42,769 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-26 15:53:42,769 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:42,769 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:42,769 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:42,770 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:42,770 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-26 15:53:42,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:42,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:42,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:42,770 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:42,771 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-26 15:53:42,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:42,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:42,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:42,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:42,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:42,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:42,773 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:53:42,773 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-26 15:53:42,774 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:42,774 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:42,774 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,774 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:42,775 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,775 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:42,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:42,775 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:42,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:42,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:42,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:42,776 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:42,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:42,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:42,777 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:42,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:42,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:42,781 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:42,781 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,781 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:42,781 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,781 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:42,781 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:42,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:42,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:42,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:42,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:42,781 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:42,782 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,782 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,782 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,782 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:42,783 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:42,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:42,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:42,883 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:42,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:42,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:42,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:42,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,893 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:42,893 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:42,893 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-26 15:53:42,893 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-26 15:53:42,894 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,894 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,895 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:42,895 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:42,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:42,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:42,896 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:42,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,896 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:42,896 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:42,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,897 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,900 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-26 15:53:42,900 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:42,900 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-26 15:53:42,900 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:42,901 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-26 15:53:42,901 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:42,901 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:42,901 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:42,901 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. started... 2023-11-26 15:53:42,901 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8929c83bb706f599f3d8e0a34ab792c9 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:43,320 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010385cf439256e2471493caeeeb2a73cf8b to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010385cf439256e2471493caeeeb2a73cf8b 2023-11-26 15:53:43,729 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/951d00e31b2d4bdcbc311dccb837e25b 2023-11-26 15:53:43,736 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/951d00e31b2d4bdcbc311dccb837e25b as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/951d00e31b2d4bdcbc311dccb837e25b 2023-11-26 15:53:43,742 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/951d00e31b2d4bdcbc311dccb837e25b, entries=1, sequenceid=33, filesize=4.9 K 2023-11-26 15:53:43,743 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8929c83bb706f599f3d8e0a34ab792c9 in 842ms, sequenceid=33, compaction requested=true 2023-11-26 15:53:43,743 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8929c83bb706f599f3d8e0a34ab792c9: 2023-11-26 15:53:43,743 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:43,744 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:43,744 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:43,744 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:43,744 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-26 15:53:43,744 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-26 15:53:43,793 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:43,793 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:43,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:43,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:43,794 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,794 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:43,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:43,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:43,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:43,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:43,795 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-26 15:53:43,795 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5343a7eb[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:43,795 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-26 15:53:43,795 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,839 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,840 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-26 15:53:43,840 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-26 15:53:43,840 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:43,840 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:43,840 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:43,878 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-26 15:53:43,878 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:43,878 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:43,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:43,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:43,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:43,878 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-26 15:53:43,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:43,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:43,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:43,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:43,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:43,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:43,881 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:53:43,881 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-26 15:53:43,881 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:43,881 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:43,882 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,882 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:43,947 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,947 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:43,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:43,947 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:43,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:43,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:43,948 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:43,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:43,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:43,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,950 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:43,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:43,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:43,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:43,986 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:43,986 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:43,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-26 15:53:43,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:43,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:43,986 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:43,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:43,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:43,986 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:43,986 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,987 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,987 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:43,987 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,987 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:43,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:43,987 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:43,987 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:43,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:43,987 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:44,087 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:44,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:44,094 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:44,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:44,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:44,098 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:44,098 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:44,098 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-26 15:53:44,098 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-26 15:53:44,099 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:44,099 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:44,162 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:44,162 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:44,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:44,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:44,163 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:44,163 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:44,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:44,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:44,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:44,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:44,164 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:44,164 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-26 15:53:44,164 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:44,164 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-26 15:53:44,164 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:44,165 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-26 15:53:44,165 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:44,165 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:44,165 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:44,165 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. started... 2023-11-26 15:53:44,165 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8929c83bb706f599f3d8e0a34ab792c9 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:44,583 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907551e99d062b24cf29d6da956f0442f5e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907551e99d062b24cf29d6da956f0442f5e 2023-11-26 15:53:44,989 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/05e94224de694c2baaf5c53ed1a62137 2023-11-26 15:53:44,995 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/05e94224de694c2baaf5c53ed1a62137 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/05e94224de694c2baaf5c53ed1a62137 2023-11-26 15:53:45,001 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/05e94224de694c2baaf5c53ed1a62137, entries=1, sequenceid=37, filesize=4.9 K 2023-11-26 15:53:45,002 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8929c83bb706f599f3d8e0a34ab792c9 in 837ms, sequenceid=37, compaction requested=true 2023-11-26 15:53:45,002 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8929c83bb706f599f3d8e0a34ab792c9: 2023-11-26 15:53:45,002 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:45,002 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:45,002 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:45,002 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,002 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-26 15:53:45,002 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-26 15:53:45,004 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,004 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:45,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:45,004 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,004 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:45,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:45,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:45,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:45,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-26 15:53:45,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75a21fa0[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:45,006 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-26 15:53:45,006 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,007 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,007 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-26 15:53:45,007 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-26 15:53:45,007 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:45,008 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,008 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:45,009 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,009 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-26 15:53:45,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:45,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:45,009 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:45,009 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-26 15:53:45,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:45,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:45,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:45,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:45,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:53:45,012 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-26 15:53:45,012 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:45,012 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:45,012 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,013 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:45,019 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,019 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:45,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:45,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,019 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:45,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:45,019 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:45,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:45,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:45,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,021 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:45,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,028 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,028 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,028 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,028 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:45,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:45,028 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:45,028 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,029 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,029 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:45,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:45,028 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:45,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:45,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-26 15:53:45,029 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,030 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:45,030 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:45,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:45,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:45,130 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:45,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:45,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:45,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:45,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,138 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:45,138 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:45,139 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-26 15:53:45,139 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-26 15:53:45,139 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,140 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,141 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,141 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:45,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:45,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:45,141 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,141 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:45,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:45,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,142 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,143 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-26 15:53:45,143 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,143 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-26 15:53:45,143 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:45,144 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-26 15:53:45,145 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:45,145 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:45,145 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:45,145 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. started... 2023-11-26 15:53:45,145 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8929c83bb706f599f3d8e0a34ab792c9 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:45,563 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112069d02c44dc9144ff929c0e8b0f419967 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112069d02c44dc9144ff929c0e8b0f419967 2023-11-26 15:53:45,969 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/73dc809aab354549818f764c3bb0019d 2023-11-26 15:53:45,976 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/73dc809aab354549818f764c3bb0019d as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/73dc809aab354549818f764c3bb0019d 2023-11-26 15:53:45,982 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/73dc809aab354549818f764c3bb0019d, entries=1, sequenceid=41, filesize=4.9 K 2023-11-26 15:53:45,983 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8929c83bb706f599f3d8e0a34ab792c9 in 838ms, sequenceid=41, compaction requested=true 2023-11-26 15:53:45,983 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8929c83bb706f599f3d8e0a34ab792c9: 2023-11-26 15:53:45,983 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:45,983 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:45,983 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:45,983 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,983 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-26 15:53:45,983 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-26 15:53:45,986 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,986 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:45,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:45,986 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,986 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:45,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:45,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:45,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:45,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-26 15:53:45,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2700c56b[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:45,988 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-26 15:53:45,988 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,989 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,990 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-26 15:53:45,990 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-26 15:53:45,990 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:45,990 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,990 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:45,991 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,991 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-26 15:53:45,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:45,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:45,991 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:45,992 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-26 15:53:45,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:45,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:45,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:45,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:45,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:53:45,995 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-26 15:53:45,995 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:45,995 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:45,995 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,995 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:45,997 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,997 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:45,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:45,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,997 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:45,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:45,997 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:45,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:45,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:45,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,998 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:45,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:45,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:45,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:46,004 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:46,004 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:46,004 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:46,004 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:46,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:46,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:46,004 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:46,004 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:46,004 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-26 15:53:46,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-26 15:53:46,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:46,004 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:46,006 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:46,006 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:46,006 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:46,006 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:46,006 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:46,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:46,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:46,106 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:46,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:46,109 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33415] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-11-26 15:53:46,111 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-26 15:53:46,112 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-26 15:53:46,113 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:53:46,113 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701014626113 2023-11-26 15:53:46,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-26 15:53:46,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-26 15:53:46,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-26 15:53:46,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] zookeeper.ReadOnlyZKClient(139): Connect 0x05e770fc to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:53:46,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26c1f171, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:53:46,120 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-26 15:53:46,956 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039a5868cfb91b4e99a5f25022871a8e73 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601039a5868cfb91b4e99a5f25022871a8e73 2023-11-26 15:53:46,957 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-26 15:53:46,970 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:53:46,971 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:53:46,980 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-26 15:53:46,982 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38594, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-26 15:53:46,998 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/d51fb76426e542bc979aa1cd9b85d23c first=Optional[r5] last=Optional[r6] 2023-11-26 15:53:46,999 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/d51fb76426e542bc979aa1cd9b85d23c}] 2023-11-26 15:53:47,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/d51fb76426e542bc979aa1cd9b85d23c for inclusion in 8929c83bb706f599f3d8e0a34ab792c9/family1 2023-11-26 15:53:47,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-26 15:53:47,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last= 2023-11-26 15:53:47,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for 8929c83bb706f599f3d8e0a34ab792c9: 2023-11-26 15:53:47,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/d51fb76426e542bc979aa1cd9b85d23c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__22s68sibi4aakdt4viq5ripd032c78oum0u8qjqrq9vqj1ni2a7gs4h71lu0p7l8/family1/d51fb76426e542bc979aa1cd9b85d23c 2023-11-26 15:53:47,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__22s68sibi4aakdt4viq5ripd032c78oum0u8qjqrq9vqj1ni2a7gs4h71lu0p7l8/family1/d51fb76426e542bc979aa1cd9b85d23c as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/ed8146f5eb714f8d8ae6ce1b26898a8e_SeqId_44_ 2023-11-26 15:53:47,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__22s68sibi4aakdt4viq5ripd032c78oum0u8qjqrq9vqj1ni2a7gs4h71lu0p7l8/family1/d51fb76426e542bc979aa1cd9b85d23c into 8929c83bb706f599f3d8e0a34ab792c9/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/ed8146f5eb714f8d8ae6ce1b26898a8e_SeqId_44_ - updating store file list. 2023-11-26 15:53:47,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/ed8146f5eb714f8d8ae6ce1b26898a8e_SeqId_44_ into 8929c83bb706f599f3d8e0a34ab792c9/family1 2023-11-26 15:53:47,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__22s68sibi4aakdt4viq5ripd032c78oum0u8qjqrq9vqj1ni2a7gs4h71lu0p7l8/family1/d51fb76426e542bc979aa1cd9b85d23c into 8929c83bb706f599f3d8e0a34ab792c9/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/ed8146f5eb714f8d8ae6ce1b26898a8e_SeqId_44_) 2023-11-26 15:53:47,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__22s68sibi4aakdt4viq5ripd032c78oum0u8qjqrq9vqj1ni2a7gs4h71lu0p7l8/family1/d51fb76426e542bc979aa1cd9b85d23c 2023-11-26 15:53:47,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-26 15:53:47,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-26 15:53:47,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(1912): 8929c83bb706f599f3d8e0a34ab792c9/family1 is initiating minor compaction 2023-11-26 15:53:47,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@53cbc202; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:53:47,027 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8929c83bb706f599f3d8e0a34ab792c9/family1 in testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:47,028 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/52c8b3a66af049d092f80d15fdc5640b, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/346cff976da54acca2b770287ae5d7cb, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/2ed8543e2fba48b6b8421e43937f4ccc, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/4c2d220008514bab92261f073953d289, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/abf36698250842a59273af446240343c, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/b2bfb0b8f36b43d0ab69d241ea9af199, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/951d00e31b2d4bdcbc311dccb837e25b, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/05e94224de694c2baaf5c53ed1a62137, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/73dc809aab354549818f764c3bb0019d, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/ed8146f5eb714f8d8ae6ce1b26898a8e_SeqId_44_] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp, totalSize=49.7 K 2023-11-26 15:53:47,028 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 52c8b3a66af049d092f80d15fdc5640b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-26 15:53:47,028 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 346cff976da54acca2b770287ae5d7cb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-26 15:53:47,028 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 2ed8543e2fba48b6b8421e43937f4ccc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-26 15:53:47,028 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 4c2d220008514bab92261f073953d289, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-26 15:53:47,028 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting abf36698250842a59273af446240343c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-26 15:53:47,028 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting b2bfb0b8f36b43d0ab69d241ea9af199, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-26 15:53:47,028 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 951d00e31b2d4bdcbc311dccb837e25b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-26 15:53:47,028 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 05e94224de694c2baaf5c53ed1a62137, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-26 15:53:47,029 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 73dc809aab354549818f764c3bb0019d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-26 15:53:47,029 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting ed8146f5eb714f8d8ae6ce1b26898a8e_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-26 15:53:47,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-26 15:53:47,032 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:53:47,034 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101d9ff02097df843daa679efd9616c8432 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101d9ff02097df843daa679efd9616c8432 2023-11-26 15:53:47,036 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010385cf439256e2471493caeeeb2a73cf8b to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010385cf439256e2471493caeeeb2a73cf8b 2023-11-26 15:53:47,036 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-26 15:53:47,036 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-26 15:53:47,037 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-26 15:53:47,037 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-26 15:53:47,093 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8929c83bb706f599f3d8e0a34ab792c9#family1#compaction#22 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:53:47,517 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/d25e31bf61194130b8657834e3db983a as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/d25e31bf61194130b8657834e3db983a 2023-11-26 15:53:47,524 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 8929c83bb706f599f3d8e0a34ab792c9/family1 of 8929c83bb706f599f3d8e0a34ab792c9 into d25e31bf61194130b8657834e3db983a(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:53:47,524 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8929c83bb706f599f3d8e0a34ab792c9: 2023-11-26 15:53:47,525 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1701014027027; duration=0sec 2023-11-26 15:53:47,525 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:53:47,623 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/52c8b3a66af049d092f80d15fdc5640b, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/346cff976da54acca2b770287ae5d7cb, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/2ed8543e2fba48b6b8421e43937f4ccc, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/4c2d220008514bab92261f073953d289, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/abf36698250842a59273af446240343c, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/b2bfb0b8f36b43d0ab69d241ea9af199, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/951d00e31b2d4bdcbc311dccb837e25b, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/05e94224de694c2baaf5c53ed1a62137, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/73dc809aab354549818f764c3bb0019d, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/ed8146f5eb714f8d8ae6ce1b26898a8e_SeqId_44_] to archive 2023-11-26 15:53:47,624 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:53:47,626 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/52c8b3a66af049d092f80d15fdc5640b to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/52c8b3a66af049d092f80d15fdc5640b 2023-11-26 15:53:47,628 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/346cff976da54acca2b770287ae5d7cb to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/346cff976da54acca2b770287ae5d7cb 2023-11-26 15:53:47,629 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/2ed8543e2fba48b6b8421e43937f4ccc to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/2ed8543e2fba48b6b8421e43937f4ccc 2023-11-26 15:53:47,631 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/4c2d220008514bab92261f073953d289 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/4c2d220008514bab92261f073953d289 2023-11-26 15:53:47,632 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/abf36698250842a59273af446240343c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/abf36698250842a59273af446240343c 2023-11-26 15:53:47,633 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/b2bfb0b8f36b43d0ab69d241ea9af199 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/b2bfb0b8f36b43d0ab69d241ea9af199 2023-11-26 15:53:47,635 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/951d00e31b2d4bdcbc311dccb837e25b to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/951d00e31b2d4bdcbc311dccb837e25b 2023-11-26 15:53:47,636 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/05e94224de694c2baaf5c53ed1a62137 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/05e94224de694c2baaf5c53ed1a62137 2023-11-26 15:53:47,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/73dc809aab354549818f764c3bb0019d to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/73dc809aab354549818f764c3bb0019d 2023-11-26 15:53:47,639 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/ed8146f5eb714f8d8ae6ce1b26898a8e_SeqId_44_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/ed8146f5eb714f8d8ae6ce1b26898a8e_SeqId_44_ 2023-11-26 15:53:47,916 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512314afb0e39239546bc975ec26fd7304dec to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512314afb0e39239546bc975ec26fd7304dec 2023-11-26 15:53:47,918 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-26 15:53:47,944 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/395786a931e8450c88559d40305ccd83 first=Optional[r1] last=Optional[r4] 2023-11-26 15:53:47,944 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/395786a931e8450c88559d40305ccd83}] 2023-11-26 15:53:47,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/395786a931e8450c88559d40305ccd83 for inclusion in 8929c83bb706f599f3d8e0a34ab792c9/family1 2023-11-26 15:53:47,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-26 15:53:47,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last= 2023-11-26 15:53:47,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for 8929c83bb706f599f3d8e0a34ab792c9: 2023-11-26 15:53:47,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/395786a931e8450c88559d40305ccd83 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__328fn6b8vhpkdh3rkumctuckgm97rr6uggn1iogjviaut74fqgqrj8gmgc3nj18g/family1/395786a931e8450c88559d40305ccd83 2023-11-26 15:53:47,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__328fn6b8vhpkdh3rkumctuckgm97rr6uggn1iogjviaut74fqgqrj8gmgc3nj18g/family1/395786a931e8450c88559d40305ccd83 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/4880a2539dbf401b9bd8cfddf25287f0_SeqId_47_ 2023-11-26 15:53:47,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__328fn6b8vhpkdh3rkumctuckgm97rr6uggn1iogjviaut74fqgqrj8gmgc3nj18g/family1/395786a931e8450c88559d40305ccd83 into 8929c83bb706f599f3d8e0a34ab792c9/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/4880a2539dbf401b9bd8cfddf25287f0_SeqId_47_ - updating store file list. 2023-11-26 15:53:47,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/4880a2539dbf401b9bd8cfddf25287f0_SeqId_47_ into 8929c83bb706f599f3d8e0a34ab792c9/family1 2023-11-26 15:53:47,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__328fn6b8vhpkdh3rkumctuckgm97rr6uggn1iogjviaut74fqgqrj8gmgc3nj18g/family1/395786a931e8450c88559d40305ccd83 into 8929c83bb706f599f3d8e0a34ab792c9/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/4880a2539dbf401b9bd8cfddf25287f0_SeqId_47_) 2023-11-26 15:53:47,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__328fn6b8vhpkdh3rkumctuckgm97rr6uggn1iogjviaut74fqgqrj8gmgc3nj18g/family1/395786a931e8450c88559d40305ccd83 2023-11-26 15:53:47,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-26 15:53:47,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-26 15:53:47,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(1912): 8929c83bb706f599f3d8e0a34ab792c9/family1 is initiating minor compaction (all files) 2023-11-26 15:53:47,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@62f65496; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:53:47,962 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8929c83bb706f599f3d8e0a34ab792c9/family1 in testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:53:47,963 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/43883dafb95d4eecb68d7042b8a65f3f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/d25e31bf61194130b8657834e3db983a, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/4880a2539dbf401b9bd8cfddf25287f0_SeqId_47_] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp, totalSize=178.1 K 2023-11-26 15:53:47,963 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 43883dafb95d4eecb68d7042b8a65f3f, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823935 2023-11-26 15:53:47,964 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting d25e31bf61194130b8657834e3db983a, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223935 2023-11-26 15:53:47,964 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 4880a2539dbf401b9bd8cfddf25287f0_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965223935 2023-11-26 15:53:47,964 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-26 15:53:47,965 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:53:47,967 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201628c8dab7d15423b8b7d793684b4b685 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201628c8dab7d15423b8b7d793684b4b685 2023-11-26 15:53:47,969 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120571dbe58f23b043be8adad5ff1a2ad14c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120571dbe58f23b043be8adad5ff1a2ad14c 2023-11-26 15:53:47,971 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512285e84c691010b4c18bf9967633314d404 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512285e84c691010b4c18bf9967633314d404 2023-11-26 15:53:47,973 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512312ce20db515d0489fbda1154ef7a471e8 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512312ce20db515d0489fbda1154ef7a471e8 2023-11-26 15:53:47,973 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-26 15:53:47,973 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-26 15:53:47,973 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-26 15:53:47,973 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-26 15:53:47,994 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8929c83bb706f599f3d8e0a34ab792c9#family1#compaction#23 average throughput is 11.97 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:53:48,008 WARN [DataStreamer for file /user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319a1892cf9b684a38b55583988e4e3458_del] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-11-26 15:53:48,438 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/.tmp/family1/9974664b35b5400f808e90ee048577b4 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/9974664b35b5400f808e90ee048577b4 2023-11-26 15:53:48,444 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 8929c83bb706f599f3d8e0a34ab792c9/family1 of 8929c83bb706f599f3d8e0a34ab792c9 into 9974664b35b5400f808e90ee048577b4(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:53:48,444 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8929c83bb706f599f3d8e0a34ab792c9: 2023-11-26 15:53:48,444 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1701014027962; duration=0sec 2023-11-26 15:53:48,444 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:53:48,458 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511305b6f62f8de8f47439314469f38806ed1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511305b6f62f8de8f47439314469f38806ed1 2023-11-26 15:53:48,459 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-26 15:53:48,485 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/58a1101573604f3895f8fdbe6bedbd22 first=Optional[r00] last=Optional[r8] 2023-11-26 15:53:48,486 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/58a1101573604f3895f8fdbe6bedbd22}] 2023-11-26 15:53:48,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/58a1101573604f3895f8fdbe6bedbd22 for inclusion in 8929c83bb706f599f3d8e0a34ab792c9/family1 2023-11-26 15:53:48,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-26 15:53:48,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last= 2023-11-26 15:53:48,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for 8929c83bb706f599f3d8e0a34ab792c9: 2023-11-26 15:53:48,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/58a1101573604f3895f8fdbe6bedbd22 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__uf8o6rjm4q10qctsbm0sphl1uf3qpi9anum3hh2soud2rqb966d7k4o5p0g2r7v7/family1/58a1101573604f3895f8fdbe6bedbd22 2023-11-26 15:53:48,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__uf8o6rjm4q10qctsbm0sphl1uf3qpi9anum3hh2soud2rqb966d7k4o5p0g2r7v7/family1/58a1101573604f3895f8fdbe6bedbd22 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/c8a7876af99a41f1815bf6e6688bf3fd_SeqId_50_ 2023-11-26 15:53:48,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__uf8o6rjm4q10qctsbm0sphl1uf3qpi9anum3hh2soud2rqb966d7k4o5p0g2r7v7/family1/58a1101573604f3895f8fdbe6bedbd22 into 8929c83bb706f599f3d8e0a34ab792c9/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/c8a7876af99a41f1815bf6e6688bf3fd_SeqId_50_ - updating store file list. 2023-11-26 15:53:48,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/c8a7876af99a41f1815bf6e6688bf3fd_SeqId_50_ into 8929c83bb706f599f3d8e0a34ab792c9/family1 2023-11-26 15:53:48,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__uf8o6rjm4q10qctsbm0sphl1uf3qpi9anum3hh2soud2rqb966d7k4o5p0g2r7v7/family1/58a1101573604f3895f8fdbe6bedbd22 into 8929c83bb706f599f3d8e0a34ab792c9/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/c8a7876af99a41f1815bf6e6688bf3fd_SeqId_50_) 2023-11-26 15:53:48,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithMonthlyPolicy__uf8o6rjm4q10qctsbm0sphl1uf3qpi9anum3hh2soud2rqb966d7k4o5p0g2r7v7/family1/58a1101573604f3895f8fdbe6bedbd22 2023-11-26 15:53:48,505 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-26 15:53:48,505 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:53:48,507 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112069d02c44dc9144ff929c0e8b0f419967 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112069d02c44dc9144ff929c0e8b0f419967 2023-11-26 15:53:48,509 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128b9a7bda109b7440ab9ac5e707ed2487c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128b9a7bda109b7440ab9ac5e707ed2487c 2023-11-26 15:53:48,510 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511303ae4c17de66a42e58f9ce5ae3724f360 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511303ae4c17de66a42e58f9ce5ae3724f360 2023-11-26 15:53:48,510 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-26 15:53:48,510 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-26 15:53:48,511 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-26 15:53:48,511 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-26 15:53:48,511 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-26 15:53:48,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-26 15:53:48,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:53:48,512 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-26 15:53:48,514 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.4020 sec 2023-11-26 15:53:48,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/43883dafb95d4eecb68d7042b8a65f3f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/d25e31bf61194130b8657834e3db983a, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/4880a2539dbf401b9bd8cfddf25287f0_SeqId_47_] to archive 2023-11-26 15:53:48,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:53:48,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/43883dafb95d4eecb68d7042b8a65f3f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/43883dafb95d4eecb68d7042b8a65f3f 2023-11-26 15:53:48,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/d25e31bf61194130b8657834e3db983a to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/d25e31bf61194130b8657834e3db983a 2023-11-26 15:53:48,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/4880a2539dbf401b9bd8cfddf25287f0_SeqId_47_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/family1/4880a2539dbf401b9bd8cfddf25287f0_SeqId_47_ 2023-11-26 15:53:48,619 INFO [Listener at localhost/43645] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=258 (was 254) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:33134 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16f88493-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16f88493-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58210@0x05e770fc-SendThread(127.0.0.1:58210) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: hconnection-0x16f88493-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:33122 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16f88493-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:33044 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:33060 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:32972 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:33002 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2040784163_17 at /127.0.0.1:33078 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:32910 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16f88493-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58210@0x05e770fc sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/3377090.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:32988 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/cluster_7fe8813b-4787-298e-1dce-07c929e273b6/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2040784163_17 at /127.0.0.1:32920 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16f88493-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:32976 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:33022 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:32924 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/cluster_7fe8813b-4787-298e-1dce-07c929e273b6/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x16f88493-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:45098 [Waiting for operation #43] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58210@0x05e770fc-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:32962 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_10729326_17 at /127.0.0.1:32898 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=634 (was 626) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=288 (was 323), ProcessCount=171 (was 172), AvailableMemoryMB=8549 (was 8559) 2023-11-26 15:53:48,630 INFO [Listener at localhost/43645] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=258, OpenFileDescriptor=634, MaxFileDescriptor=60000, SystemLoadAverage=288, ProcessCount=171, AvailableMemoryMB=8548 2023-11-26 15:53:48,632 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-26 15:53:48,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:48,635 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-26 15:53:48,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-11-26 15:53:48,635 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-26 15:53:48,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-26 15:53:48,637 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd 2023-11-26 15:53:48,638 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd empty. 2023-11-26 15:53:48,638 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd 2023-11-26 15:53:48,638 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-11-26 15:53:48,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-26 15:53:48,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-26 15:53:49,052 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-26 15:53:49,053 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 93605f22caa460b5319b75b058b5fadd, NAME => 'testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:53:49,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-26 15:53:49,461 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:53:49,461 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 93605f22caa460b5319b75b058b5fadd, disabling compactions & flushes 2023-11-26 15:53:49,461 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:49,461 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:49,461 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. after waiting 0 ms 2023-11-26 15:53:49,461 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:49,461 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:49,461 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 93605f22caa460b5319b75b058b5fadd: 2023-11-26 15:53:49,464 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-26 15:53:49,465 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701014029464"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014029464"}]},"ts":"1701014029464"} 2023-11-26 15:53:49,466 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-26 15:53:49,467 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-26 15:53:49,468 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014029467"}]},"ts":"1701014029467"} 2023-11-26 15:53:49,469 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-26 15:53:49,472 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=93605f22caa460b5319b75b058b5fadd, ASSIGN}] 2023-11-26 15:53:49,474 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=93605f22caa460b5319b75b058b5fadd, ASSIGN 2023-11-26 15:53:49,475 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=93605f22caa460b5319b75b058b5fadd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:53:49,626 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=93605f22caa460b5319b75b058b5fadd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:49,626 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701014029626"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014029626"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014029626"}]},"ts":"1701014029626"} 2023-11-26 15:53:49,628 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 93605f22caa460b5319b75b058b5fadd, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:53:49,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-26 15:53:49,780 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:49,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:49,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 93605f22caa460b5319b75b058b5fadd, NAME => 'testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd.', STARTKEY => '', ENDKEY => ''} 2023-11-26 15:53:49,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 93605f22caa460b5319b75b058b5fadd 2023-11-26 15:53:49,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:53:49,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 93605f22caa460b5319b75b058b5fadd 2023-11-26 15:53:49,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 93605f22caa460b5319b75b058b5fadd 2023-11-26 15:53:49,786 INFO [StoreOpener-93605f22caa460b5319b75b058b5fadd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 93605f22caa460b5319b75b058b5fadd 2023-11-26 15:53:49,788 DEBUG [StoreOpener-93605f22caa460b5319b75b058b5fadd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1 2023-11-26 15:53:49,788 DEBUG [StoreOpener-93605f22caa460b5319b75b058b5fadd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1 2023-11-26 15:53:49,788 INFO [StoreOpener-93605f22caa460b5319b75b058b5fadd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 93605f22caa460b5319b75b058b5fadd columnFamilyName family1 2023-11-26 15:53:49,790 INFO [StoreOpener-93605f22caa460b5319b75b058b5fadd-1] regionserver.HStore(310): Store=93605f22caa460b5319b75b058b5fadd/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:53:49,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd 2023-11-26 15:53:49,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd 2023-11-26 15:53:49,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 93605f22caa460b5319b75b058b5fadd 2023-11-26 15:53:49,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:53:49,796 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 93605f22caa460b5319b75b058b5fadd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64954592, jitterRate=-0.03210115432739258}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-26 15:53:49,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 93605f22caa460b5319b75b058b5fadd: 2023-11-26 15:53:49,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd., pid=25, masterSystemTime=1701014029780 2023-11-26 15:53:49,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:49,799 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:49,799 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=93605f22caa460b5319b75b058b5fadd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:49,800 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701014029799"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014029799"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014029799"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014029799"}]},"ts":"1701014029799"} 2023-11-26 15:53:49,803 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=25, resume processing ppid=24 2023-11-26 15:53:49,803 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 93605f22caa460b5319b75b058b5fadd, server=jenkins-hbase4.apache.org,41861,1701014000937 in 173 msec 2023-11-26 15:53:49,805 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=24, resume processing ppid=23 2023-11-26 15:53:49,805 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=93605f22caa460b5319b75b058b5fadd, ASSIGN in 331 msec 2023-11-26 15:53:49,806 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-26 15:53:49,806 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014029806"}]},"ts":"1701014029806"} 2023-11-26 15:53:49,807 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-26 15:53:49,810 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-26 15:53:49,811 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1780 sec 2023-11-26 15:53:50,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-26 15:53:50,743 INFO [Listener at localhost/43645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-11-26 15:53:50,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:50,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:50,773 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:50,774 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:50,774 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-26 15:53:50,774 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-26 15:53:50,774 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:50,774 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:50,776 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:50,776 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:50,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:50,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:50,776 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:50,777 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:50,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:50,777 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:50,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:50,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:50,777 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:50,778 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:50,778 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-26 15:53:50,778 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:50,778 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-26 15:53:50,778 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:50,778 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:50,778 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:50,778 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. started... 2023-11-26 15:53:50,779 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 93605f22caa460b5319b75b058b5fadd 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-26 15:53:51,199 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a22435733e344b1d9d2c197a451b866d to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130a22435733e344b1d9d2c197a451b866d 2023-11-26 15:53:51,203 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/9b418e3ead8d45b5aeeb4314679f05c3 2023-11-26 15:53:51,209 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/9b418e3ead8d45b5aeeb4314679f05c3 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/9b418e3ead8d45b5aeeb4314679f05c3 2023-11-26 15:53:51,214 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/9b418e3ead8d45b5aeeb4314679f05c3, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-26 15:53:51,216 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 93605f22caa460b5319b75b058b5fadd in 437ms, sequenceid=5, compaction requested=false 2023-11-26 15:53:51,216 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:51,217 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 93605f22caa460b5319b75b058b5fadd: 2023-11-26 15:53:51,217 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:51,217 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:51,217 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:51,217 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,217 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-26 15:53:51,217 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-26 15:53:51,220 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,220 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:51,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:51,220 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,220 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:51,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:51,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:51,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:51,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-26 15:53:51,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6243f0c3[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:51,222 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-26 15:53:51,222 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,224 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,225 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-26 15:53:51,225 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-26 15:53:51,225 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:51,225 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,225 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:51,226 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,226 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-26 15:53:51,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:51,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:51,226 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:51,226 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-26 15:53:51,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:51,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:51,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:51,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:51,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:53:51,232 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-26 15:53:51,232 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:51,232 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:51,232 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,232 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:51,234 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,234 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:51,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:51,234 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:51,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:51,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:51,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:51,235 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:51,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,236 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:51,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,240 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,240 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,240 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,240 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,240 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,240 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:51,240 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:51,240 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:51,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:51,240 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:51,240 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:51,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:51,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:51,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:51,241 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:51,241 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:51,341 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:51,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:51,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:51,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:51,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,348 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:51,348 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:51,348 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-26 15:53:51,348 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-26 15:53:51,349 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,349 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,351 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,351 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:51,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:51,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:51,351 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,351 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:51,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:51,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,352 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,353 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-26 15:53:51,353 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,353 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-26 15:53:51,353 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:51,353 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-26 15:53:51,353 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:51,353 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:51,353 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:51,353 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. started... 2023-11-26 15:53:51,353 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 93605f22caa460b5319b75b058b5fadd 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-26 15:53:51,768 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511281166f920bf124c00a10c25e2a8362cdc to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511281166f920bf124c00a10c25e2a8362cdc 2023-11-26 15:53:51,773 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/1bcfa85a7dff4505b894d609568c39b6 2023-11-26 15:53:51,779 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/1bcfa85a7dff4505b894d609568c39b6 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/1bcfa85a7dff4505b894d609568c39b6 2023-11-26 15:53:51,784 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/1bcfa85a7dff4505b894d609568c39b6, entries=1, sequenceid=9, filesize=5.0 K 2023-11-26 15:53:51,785 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 93605f22caa460b5319b75b058b5fadd in 432ms, sequenceid=9, compaction requested=false 2023-11-26 15:53:51,785 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 93605f22caa460b5319b75b058b5fadd: 2023-11-26 15:53:51,785 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:51,785 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:51,785 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:51,785 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,785 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-26 15:53:51,785 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-26 15:53:51,789 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,789 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:51,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:51,790 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,790 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:51,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:51,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:51,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:51,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-26 15:53:51,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cf17f9f[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:51,792 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-26 15:53:51,792 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,793 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,794 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-26 15:53:51,794 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-26 15:53:51,794 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,794 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:51,794 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:51,796 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,796 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-26 15:53:51,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:51,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:51,796 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:51,796 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-26 15:53:51,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:51,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:51,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:51,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:51,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:53:51,801 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-26 15:53:51,801 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:51,801 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:51,801 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,801 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:51,803 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,803 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,803 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:51,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:51,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:51,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:51,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:51,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:51,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,805 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:51,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,806 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:51,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,809 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,809 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:51,809 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:51,809 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:51,809 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:51,809 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:51,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:51,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:51,809 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,809 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,809 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,809 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,810 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:51,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:51,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:51,810 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:51,910 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:51,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:51,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:51,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:51,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,917 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:51,917 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:51,917 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-26 15:53:51,917 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-26 15:53:51,918 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,918 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,919 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,919 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:51,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:51,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:51,920 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:51,920 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:51,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,920 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:51,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,921 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,921 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-26 15:53:51,921 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:51,921 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-26 15:53:51,921 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:51,921 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-26 15:53:51,921 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:51,921 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:51,921 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:51,921 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. started... 2023-11-26 15:53:51,922 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 93605f22caa460b5319b75b058b5fadd 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:52,337 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ab660e4c2dd94e5bb13b78fdb6ef0f12 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201ab660e4c2dd94e5bb13b78fdb6ef0f12 2023-11-26 15:53:52,744 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/ae333a041ce7420182f293a539e984f8 2023-11-26 15:53:52,750 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/ae333a041ce7420182f293a539e984f8 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/ae333a041ce7420182f293a539e984f8 2023-11-26 15:53:52,754 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/ae333a041ce7420182f293a539e984f8, entries=1, sequenceid=13, filesize=4.9 K 2023-11-26 15:53:52,755 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 93605f22caa460b5319b75b058b5fadd in 833ms, sequenceid=13, compaction requested=true 2023-11-26 15:53:52,755 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 93605f22caa460b5319b75b058b5fadd: 2023-11-26 15:53:52,755 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:52,755 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:52,755 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:52,756 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:52,756 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-26 15:53:52,756 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-26 15:53:52,759 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,759 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:52,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:52,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:52,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:52,759 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,760 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:52,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:52,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:52,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:52,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:52,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-26 15:53:52,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@494b2abe[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:52,761 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-26 15:53:52,762 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,763 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,763 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-26 15:53:52,763 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-26 15:53:52,763 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:52,763 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:52,763 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:52,764 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:52,764 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-26 15:53:52,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:52,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:52,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:52,765 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:52,765 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-26 15:53:52,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:52,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:52,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:52,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:52,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:52,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:52,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:53:52,767 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-26 15:53:52,768 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:52,768 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:52,768 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,768 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:52,769 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,769 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:52,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:52,770 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:52,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,770 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:52,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:52,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:52,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:52,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:52,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,771 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:52,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:52,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:52,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:52,775 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:52,775 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,775 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:52,775 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,775 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:52,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-26 15:53:52,775 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:52,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:52,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:52,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:52,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:52,775 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:52,775 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,776 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:52,776 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,776 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:52,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:52,776 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:52,876 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:52,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:52,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:52,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:52,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,883 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:52,883 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:52,883 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-26 15:53:52,883 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-26 15:53:52,883 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,884 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,885 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:52,885 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:52,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:52,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:52,885 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:52,885 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:52,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,886 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:52,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,886 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,887 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-26 15:53:52,887 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:52,887 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-26 15:53:52,887 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:52,887 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-26 15:53:52,887 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:52,887 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:52,887 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:52,887 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. started... 2023-11-26 15:53:52,887 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 93605f22caa460b5319b75b058b5fadd 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:53,305 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052926a1d1534545ef89b4a9fa12be7658 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512052926a1d1534545ef89b4a9fa12be7658 2023-11-26 15:53:53,711 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/287e4dcad64b4dbb9b07500db3600857 2023-11-26 15:53:53,717 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/287e4dcad64b4dbb9b07500db3600857 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/287e4dcad64b4dbb9b07500db3600857 2023-11-26 15:53:53,722 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/287e4dcad64b4dbb9b07500db3600857, entries=1, sequenceid=17, filesize=4.9 K 2023-11-26 15:53:53,723 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 93605f22caa460b5319b75b058b5fadd in 836ms, sequenceid=17, compaction requested=true 2023-11-26 15:53:53,723 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 93605f22caa460b5319b75b058b5fadd: 2023-11-26 15:53:53,723 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:53,723 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:53,723 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:53,723 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:53,723 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-26 15:53:53,723 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-26 15:53:53,725 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:53,725 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:53,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:53,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:53,726 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,726 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:53,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:53,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:53,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:53,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:53,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-26 15:53:53,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68419561[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:53,727 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-26 15:53:53,727 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,728 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,729 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-26 15:53:53,729 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-26 15:53:53,729 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:53,729 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:53,729 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:53,731 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-26 15:53:53,731 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:53,731 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:53,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:53,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:53,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:53,731 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-26 15:53:53,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:53,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:53,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:53,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:53,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:53,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:53,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:53:53,734 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-26 15:53:53,734 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:53,734 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:53,734 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,734 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:53,736 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,736 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:53,736 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:53,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:53,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,737 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:53,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:53,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:53,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:53,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:53,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,739 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:53,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:53,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:53,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:53,744 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:53,744 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:53,744 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:53,744 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,744 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:53,744 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:53,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-26 15:53:53,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:53,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:53,744 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:53,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:53,744 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,745 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,745 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,745 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:53,745 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:53,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:53,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:53,845 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:53,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:53,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:53,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:53,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,853 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:53,853 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:53,853 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-26 15:53:53,853 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-26 15:53:53,854 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,854 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,856 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:53,856 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:53,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:53,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:53,857 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:53,857 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:53,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:53,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,858 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,858 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-26 15:53:53,858 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:53,858 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-26 15:53:53,858 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:53,858 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-26 15:53:53,858 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:53,858 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:53,858 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:53,858 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. started... 2023-11-26 15:53:53,858 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 93605f22caa460b5319b75b058b5fadd 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:54,273 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228addd0d4ac55b47719271928d6c3264e0 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228addd0d4ac55b47719271928d6c3264e0 2023-11-26 15:53:54,679 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/0dacca379df94af5a6b567027d8b218a 2023-11-26 15:53:54,685 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/0dacca379df94af5a6b567027d8b218a as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/0dacca379df94af5a6b567027d8b218a 2023-11-26 15:53:54,690 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/0dacca379df94af5a6b567027d8b218a, entries=1, sequenceid=21, filesize=4.9 K 2023-11-26 15:53:54,691 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 93605f22caa460b5319b75b058b5fadd in 833ms, sequenceid=21, compaction requested=true 2023-11-26 15:53:54,691 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 93605f22caa460b5319b75b058b5fadd: 2023-11-26 15:53:54,691 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:54,691 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:54,691 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:54,691 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:54,691 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-26 15:53:54,691 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-26 15:53:54,693 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:54,693 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:54,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:54,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:54,694 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:54,694 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:54,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:54,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:54,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:54,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-26 15:53:54,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15f9b542[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:54,695 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-26 15:53:54,695 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,696 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,697 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-26 15:53:54,697 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-26 15:53:54,697 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:54,697 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:54,697 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:54,698 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:54,698 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-26 15:53:54,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:54,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:54,699 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:54,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:54,699 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-26 15:53:54,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:54,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:54,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:54,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:54,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:54,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:54,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:53:54,701 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-26 15:53:54,702 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:54,702 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:54,702 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,702 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:54,705 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,705 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:54,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:54,705 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:54,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:54,705 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:54,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:54,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:54,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:54,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:54,707 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:54,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:54,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:54,709 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:54,709 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,709 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,709 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:54,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:54,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:54,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:54,710 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:54,710 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:54,710 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:54,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:54,710 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:54,710 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,710 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:54,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:54,710 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:54,710 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,810 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:54,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:54,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:54,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:54,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,819 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:54,819 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:54,819 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-26 15:53:54,819 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-26 15:53:54,819 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,819 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,821 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:54,821 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:54,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:54,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:54,821 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:54,821 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:54,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,822 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:54,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,822 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,822 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-26 15:53:54,822 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:54,822 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-26 15:53:54,822 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:54,823 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-26 15:53:54,823 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:54,823 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:54,823 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:54,823 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. started... 2023-11-26 15:53:54,823 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 93605f22caa460b5319b75b058b5fadd 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:55,237 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316633c49e97c64d57b052fc5ba17c74d7 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512316633c49e97c64d57b052fc5ba17c74d7 2023-11-26 15:53:55,321 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-26 15:53:55,644 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/07f18168a19144faac545504dd076dd0 2023-11-26 15:53:55,650 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/07f18168a19144faac545504dd076dd0 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/07f18168a19144faac545504dd076dd0 2023-11-26 15:53:55,655 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/07f18168a19144faac545504dd076dd0, entries=1, sequenceid=25, filesize=4.9 K 2023-11-26 15:53:55,656 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 93605f22caa460b5319b75b058b5fadd in 833ms, sequenceid=25, compaction requested=true 2023-11-26 15:53:55,656 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 93605f22caa460b5319b75b058b5fadd: 2023-11-26 15:53:55,656 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:55,657 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:55,657 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:55,657 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:55,657 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-26 15:53:55,657 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-26 15:53:55,659 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,659 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:55,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:55,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:55,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:55,659 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,659 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:55,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:55,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:55,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:55,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:55,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-26 15:53:55,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32d33de5[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:55,661 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-26 15:53:55,662 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,663 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,663 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-26 15:53:55,663 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-26 15:53:55,663 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:55,663 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:55,663 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:55,665 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:55,665 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-26 15:53:55,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:55,665 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:55,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:55,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:55,665 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-26 15:53:55,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:55,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:55,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:55,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:55,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:55,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:55,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:53:55,668 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-26 15:53:55,668 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:55,668 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:55,668 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,668 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:55,670 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,670 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,670 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:55,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:55,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:55,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:55,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:55,671 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:55,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:55,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:55,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,672 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:55,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:55,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:55,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:55,675 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:55,675 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,675 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:55,675 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,675 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:55,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:55,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:55,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:55,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:55,675 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:55,675 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:55,675 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,675 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,675 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:55,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-26 15:53:55,675 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,675 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:55,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:55,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:55,776 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:55,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:55,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:55,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:55,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,783 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:55,783 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:55,784 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-26 15:53:55,784 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-26 15:53:55,784 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,784 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,786 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:55,786 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:55,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:55,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:55,786 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:55,786 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:55,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:55,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,788 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,789 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-26 15:53:55,789 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:55,789 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-26 15:53:55,789 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:55,789 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-26 15:53:55,789 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:55,789 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:55,789 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:55,789 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. started... 2023-11-26 15:53:55,789 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 93605f22caa460b5319b75b058b5fadd 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:56,205 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f20fd4586c834fad99028a23315f5f95 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101f20fd4586c834fad99028a23315f5f95 2023-11-26 15:53:56,211 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/e588783674e14f60ab05393ed18a16bb 2023-11-26 15:53:56,217 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/e588783674e14f60ab05393ed18a16bb as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/e588783674e14f60ab05393ed18a16bb 2023-11-26 15:53:56,222 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/e588783674e14f60ab05393ed18a16bb, entries=1, sequenceid=29, filesize=4.9 K 2023-11-26 15:53:56,223 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 93605f22caa460b5319b75b058b5fadd in 434ms, sequenceid=29, compaction requested=true 2023-11-26 15:53:56,223 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 93605f22caa460b5319b75b058b5fadd: 2023-11-26 15:53:56,224 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:56,224 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:56,224 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:56,224 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:56,224 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-26 15:53:56,224 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-26 15:53:56,226 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:56,226 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:56,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:56,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:56,226 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,226 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:56,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:56,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:56,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:56,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:56,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-26 15:53:56,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22ddffdb[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:56,228 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-26 15:53:56,228 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,230 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,231 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-26 15:53:56,231 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-26 15:53:56,231 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:56,231 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:56,231 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:56,232 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:56,232 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-26 15:53:56,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:56,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:56,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:56,232 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:56,232 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-26 15:53:56,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:56,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:56,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:56,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:56,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:56,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:56,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:53:56,235 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-26 15:53:56,235 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:56,235 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:56,235 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,235 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:56,240 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,240 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:56,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:56,240 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:56,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:56,241 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:56,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:56,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:56,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:56,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:56,242 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:56,246 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:56,246 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,246 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:56,246 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,246 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:56,246 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:56,246 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-26 15:53:56,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:56,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:56,246 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:56,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:56,247 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,247 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,247 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,247 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:56,247 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:56,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:56,347 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:56,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:56,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:56,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:56,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,355 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:56,355 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:56,355 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-26 15:53:56,355 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-26 15:53:56,356 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,356 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,357 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:56,357 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:56,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:56,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:56,358 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:56,358 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:56,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:56,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,359 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,359 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-26 15:53:56,359 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:56,359 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-26 15:53:56,359 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:56,359 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-26 15:53:56,359 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:56,359 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:56,359 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:56,359 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. started... 2023-11-26 15:53:56,359 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 93605f22caa460b5319b75b058b5fadd 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:56,774 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010394c8b52bd8734bae8a8431cd44441b22 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010394c8b52bd8734bae8a8431cd44441b22 2023-11-26 15:53:57,180 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/2eb4664a66224ce9b8e5ff744de1495d 2023-11-26 15:53:57,186 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/2eb4664a66224ce9b8e5ff744de1495d as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/2eb4664a66224ce9b8e5ff744de1495d 2023-11-26 15:53:57,191 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/2eb4664a66224ce9b8e5ff744de1495d, entries=1, sequenceid=33, filesize=4.9 K 2023-11-26 15:53:57,192 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 93605f22caa460b5319b75b058b5fadd in 833ms, sequenceid=33, compaction requested=true 2023-11-26 15:53:57,192 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 93605f22caa460b5319b75b058b5fadd: 2023-11-26 15:53:57,192 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:57,192 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:57,192 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:57,192 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:57,192 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-26 15:53:57,192 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-26 15:53:57,194 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:57,194 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:57,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:57,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:57,194 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:57,194 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:57,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:57,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-26 15:53:57,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46538c7c[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:57,196 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-26 15:53:57,196 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,197 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,197 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:57,197 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:57,197 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-26 15:53:57,197 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-26 15:53:57,197 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:57,200 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-26 15:53:57,200 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:57,200 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:57,200 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-26 15:53:57,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:57,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:57,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:57,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:57,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:57,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:57,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:57,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:53:57,203 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-26 15:53:57,203 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:57,203 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:57,203 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,203 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:57,205 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,205 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:57,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:57,205 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:57,205 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:57,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:57,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:57,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:57,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:57,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,207 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:57,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:57,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:57,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:57,209 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:57,209 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,209 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:57,209 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:57,209 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:57,210 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,209 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:57,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:57,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-26 15:53:57,210 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:57,210 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:57,210 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:57,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:57,210 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:57,210 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:57,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:57,311 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:57,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:57,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:57,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:57,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,318 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:57,318 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:57,318 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-26 15:53:57,318 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-26 15:53:57,318 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,318 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,320 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:57,320 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:57,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:57,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:57,320 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:57,320 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:57,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,321 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:57,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,321 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,322 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-26 15:53:57,322 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:57,322 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-26 15:53:57,322 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:57,322 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-26 15:53:57,322 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:57,322 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:57,322 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:57,322 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. started... 2023-11-26 15:53:57,322 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 93605f22caa460b5319b75b058b5fadd 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:57,736 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090744d581b4fb4f4f41b2924bb8c62fbae4 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015090744d581b4fb4f4f41b2924bb8c62fbae4 2023-11-26 15:53:58,142 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/54c251d5a8804c1cb936b72b968879af 2023-11-26 15:53:58,148 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/54c251d5a8804c1cb936b72b968879af as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/54c251d5a8804c1cb936b72b968879af 2023-11-26 15:53:58,154 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/54c251d5a8804c1cb936b72b968879af, entries=1, sequenceid=37, filesize=4.9 K 2023-11-26 15:53:58,155 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 93605f22caa460b5319b75b058b5fadd in 833ms, sequenceid=37, compaction requested=true 2023-11-26 15:53:58,155 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 93605f22caa460b5319b75b058b5fadd: 2023-11-26 15:53:58,155 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:58,155 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:58,155 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:58,155 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:58,155 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-26 15:53:58,155 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-26 15:53:58,158 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:58,158 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:58,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:58,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:58,158 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,158 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:58,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:58,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:58,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:58,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:58,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-26 15:53:58,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ed87251[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:58,160 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-26 15:53:58,160 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,162 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,162 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-26 15:53:58,162 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-26 15:53:58,162 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:58,162 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:58,162 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:58,163 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-26 15:53:58,164 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:58,163 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:58,164 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-26 15:53:58,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:58,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:58,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:58,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:58,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:58,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:58,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:58,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:58,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:58,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:53:58,167 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-26 15:53:58,167 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:58,167 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:58,167 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,167 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:58,169 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,169 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,169 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:58,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:58,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:58,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:58,170 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:58,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,171 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:58,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:58,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:58,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:58,175 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:58,175 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,175 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,175 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:58,175 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:58,175 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:58,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:58,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:58,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:58,175 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:58,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:58,175 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,176 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:58,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-26 15:53:58,176 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:58,176 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,176 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:58,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:58,276 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:58,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:58,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:53:58,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:53:58,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,283 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:58,283 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:58,283 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-26 15:53:58,284 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-26 15:53:58,284 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,284 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,285 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:58,285 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:58,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:58,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:58,286 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:58,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,286 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:53:58,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:53:58,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,287 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,287 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-26 15:53:58,287 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:58,287 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-26 15:53:58,287 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:53:58,287 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-26 15:53:58,287 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:53:58,287 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:53:58,287 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:58,287 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. started... 2023-11-26 15:53:58,287 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 93605f22caa460b5319b75b058b5fadd 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:53:58,702 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112001dc2fd4543e429bb52b025d6b5bae16 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015112001dc2fd4543e429bb52b025d6b5bae16 2023-11-26 15:53:59,109 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/50c1b4ee019e4f49b23735dc18f12ec2 2023-11-26 15:53:59,115 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/50c1b4ee019e4f49b23735dc18f12ec2 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/50c1b4ee019e4f49b23735dc18f12ec2 2023-11-26 15:53:59,120 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/50c1b4ee019e4f49b23735dc18f12ec2, entries=1, sequenceid=41, filesize=4.9 K 2023-11-26 15:53:59,122 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 93605f22caa460b5319b75b058b5fadd in 835ms, sequenceid=41, compaction requested=true 2023-11-26 15:53:59,122 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 93605f22caa460b5319b75b058b5fadd: 2023-11-26 15:53:59,122 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:59,122 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:53:59,122 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:53:59,122 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:59,122 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-26 15:53:59,122 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-26 15:53:59,124 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:59,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:59,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:59,124 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:59,125 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,125 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:53:59,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:59,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:59,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:59,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:59,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-26 15:53:59,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@354f487a[Count = 0] remaining members to acquire global barrier 2023-11-26 15:53:59,127 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-26 15:53:59,127 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,131 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,131 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-26 15:53:59,132 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-26 15:53:59,132 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:53:59,132 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:59,132 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:53:59,133 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:59,133 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-26 15:53:59,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:59,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:59,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:59,133 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:59,134 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-26 15:53:59,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:59,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:59,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:59,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:59,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:59,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:53:59,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:53:59,136 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-26 15:53:59,136 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:53:59,136 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:53:59,136 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,136 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:53:59,138 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,138 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:53:59,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:53:59,138 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:59,139 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:59,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:59,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:59,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:53:59,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:53:59,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,140 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:59,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:59,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:53:59,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:59,143 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:59,143 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,143 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:53:59,143 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:53:59,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-26 15:53:59,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-26 15:53:59,143 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:53:59,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:53:59,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:53:59,143 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:53:59,143 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:53:59,143 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,143 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,143 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:53:59,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:53:59,143 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:53:59,143 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:53:59,244 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:53:59,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:53:59,246 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33415] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-11-26 15:53:59,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-26 15:53:59,249 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-26 15:53:59,250 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701014639250 2023-11-26 15:53:59,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:53:59,251 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-26 15:53:59,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-26 15:53:59,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-26 15:53:59,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] zookeeper.ReadOnlyZKClient(139): Connect 0x5b986e73 to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:53:59,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72fb4608, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:53:59,261 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-26 15:53:59,705 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a92497dec55c48bea46c99c71198dee8 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103a92497dec55c48bea46c99c71198dee8 2023-11-26 15:53:59,707 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-26 15:53:59,720 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:53:59,721 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:53:59,728 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-26 15:53:59,730 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56016, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-26 15:53:59,739 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4a1710966e9a42ed9991d9d70eb600dc first=Optional[r3] last=Optional[r6] 2023-11-26 15:53:59,740 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4a1710966e9a42ed9991d9d70eb600dc}] 2023-11-26 15:53:59,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4a1710966e9a42ed9991d9d70eb600dc for inclusion in 93605f22caa460b5319b75b058b5fadd/family1 2023-11-26 15:53:59,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-26 15:53:59,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last= 2023-11-26 15:53:59,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for 93605f22caa460b5319b75b058b5fadd: 2023-11-26 15:53:59,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/4a1710966e9a42ed9991d9d70eb600dc to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__66gidnnl1itusd92vdv008msuro3bhc6t1j5nigl7ekrbbjaltuk91lebd05cu54/family1/4a1710966e9a42ed9991d9d70eb600dc 2023-11-26 15:53:59,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__66gidnnl1itusd92vdv008msuro3bhc6t1j5nigl7ekrbbjaltuk91lebd05cu54/family1/4a1710966e9a42ed9991d9d70eb600dc as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/49e09319d8fa4eba8816cf401b6d789c_SeqId_44_ 2023-11-26 15:53:59,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__66gidnnl1itusd92vdv008msuro3bhc6t1j5nigl7ekrbbjaltuk91lebd05cu54/family1/4a1710966e9a42ed9991d9d70eb600dc into 93605f22caa460b5319b75b058b5fadd/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/49e09319d8fa4eba8816cf401b6d789c_SeqId_44_ - updating store file list. 2023-11-26 15:53:59,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/49e09319d8fa4eba8816cf401b6d789c_SeqId_44_ into 93605f22caa460b5319b75b058b5fadd/family1 2023-11-26 15:53:59,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__66gidnnl1itusd92vdv008msuro3bhc6t1j5nigl7ekrbbjaltuk91lebd05cu54/family1/4a1710966e9a42ed9991d9d70eb600dc into 93605f22caa460b5319b75b058b5fadd/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/49e09319d8fa4eba8816cf401b6d789c_SeqId_44_) 2023-11-26 15:53:59,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__66gidnnl1itusd92vdv008msuro3bhc6t1j5nigl7ekrbbjaltuk91lebd05cu54/family1/4a1710966e9a42ed9991d9d70eb600dc 2023-11-26 15:53:59,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-26 15:53:59,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-26 15:53:59,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(1912): 93605f22caa460b5319b75b058b5fadd/family1 is initiating minor compaction 2023-11-26 15:53:59,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@737f4584; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:53:59,763 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 93605f22caa460b5319b75b058b5fadd/family1 in testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:53:59,763 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/1bcfa85a7dff4505b894d609568c39b6, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/ae333a041ce7420182f293a539e984f8, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/287e4dcad64b4dbb9b07500db3600857, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/0dacca379df94af5a6b567027d8b218a, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/07f18168a19144faac545504dd076dd0, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/e588783674e14f60ab05393ed18a16bb, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/2eb4664a66224ce9b8e5ff744de1495d, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/54c251d5a8804c1cb936b72b968879af, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/50c1b4ee019e4f49b23735dc18f12ec2, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/49e09319d8fa4eba8816cf401b6d789c_SeqId_44_] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp, totalSize=50.0 K 2023-11-26 15:53:59,763 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 1bcfa85a7dff4505b894d609568c39b6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-26 15:53:59,763 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting ae333a041ce7420182f293a539e984f8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-26 15:53:59,763 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 287e4dcad64b4dbb9b07500db3600857, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-26 15:53:59,763 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 0dacca379df94af5a6b567027d8b218a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-26 15:53:59,763 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 07f18168a19144faac545504dd076dd0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-26 15:53:59,763 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting e588783674e14f60ab05393ed18a16bb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-26 15:53:59,764 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 2eb4664a66224ce9b8e5ff744de1495d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-26 15:53:59,764 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 54c251d5a8804c1cb936b72b968879af, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-26 15:53:59,764 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 50c1b4ee019e4f49b23735dc18f12ec2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-26 15:53:59,764 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 49e09319d8fa4eba8816cf401b6d789c_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-26 15:53:59,765 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-26 15:53:59,766 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:53:59,768 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228addd0d4ac55b47719271928d6c3264e0 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228addd0d4ac55b47719271928d6c3264e0 2023-11-26 15:53:59,770 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512316633c49e97c64d57b052fc5ba17c74d7 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512316633c49e97c64d57b052fc5ba17c74d7 2023-11-26 15:53:59,771 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101f20fd4586c834fad99028a23315f5f95 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101f20fd4586c834fad99028a23315f5f95 2023-11-26 15:53:59,773 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010394c8b52bd8734bae8a8431cd44441b22 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010394c8b52bd8734bae8a8431cd44441b22 2023-11-26 15:53:59,773 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-26 15:53:59,773 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-26 15:53:59,773 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-26 15:53:59,774 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-26 15:53:59,774 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-26 15:53:59,774 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-26 15:53:59,774 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-26 15:53:59,774 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-26 15:53:59,774 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-26 15:53:59,774 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-26 15:53:59,817 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] throttle.PressureAwareThroughputController(145): 93605f22caa460b5319b75b058b5fadd#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:54:00,398 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-26 15:54:00,398 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7620bb47 to 127.0.0.1:58210 2023-11-26 15:54:00,398 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:54:00,399 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-26 15:54:00,399 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x611bfd54 to 127.0.0.1:58210 2023-11-26 15:54:00,400 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:54:00,400 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-26 15:54:00,400 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05e770fc to 127.0.0.1:58210 2023-11-26 15:54:00,400 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:54:00,628 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d7f6e73128d04c4bb380d34023274222 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205d7f6e73128d04c4bb380d34023274222 2023-11-26 15:54:00,629 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-26 15:54:00,633 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/fef3e2850b604540867a1a0f83bed9b3 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/fef3e2850b604540867a1a0f83bed9b3 2023-11-26 15:54:00,639 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 93605f22caa460b5319b75b058b5fadd/family1 of 93605f22caa460b5319b75b058b5fadd into fef3e2850b604540867a1a0f83bed9b3(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:54:00,639 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 93605f22caa460b5319b75b058b5fadd: 2023-11-26 15:54:00,639 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1701014039762; duration=0sec 2023-11-26 15:54:00,639 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:54:00,654 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ababb2ebdea34aaeaedb0c0f7861038e first=Optional[r1] last=Optional[r2] 2023-11-26 15:54:00,655 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ababb2ebdea34aaeaedb0c0f7861038e}] 2023-11-26 15:54:00,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ababb2ebdea34aaeaedb0c0f7861038e for inclusion in 93605f22caa460b5319b75b058b5fadd/family1 2023-11-26 15:54:00,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-26 15:54:00,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last= 2023-11-26 15:54:00,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for 93605f22caa460b5319b75b058b5fadd: 2023-11-26 15:54:00,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ababb2ebdea34aaeaedb0c0f7861038e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__e8faangdpq1tpp90bqvu7dqhf4t86j4rj5o50g4f0q5tdqce38382avl7n3j0iut/family1/ababb2ebdea34aaeaedb0c0f7861038e 2023-11-26 15:54:00,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__e8faangdpq1tpp90bqvu7dqhf4t86j4rj5o50g4f0q5tdqce38382avl7n3j0iut/family1/ababb2ebdea34aaeaedb0c0f7861038e as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/ab1209fe8c8841659e9605dc78f1e554_SeqId_47_ 2023-11-26 15:54:00,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__e8faangdpq1tpp90bqvu7dqhf4t86j4rj5o50g4f0q5tdqce38382avl7n3j0iut/family1/ababb2ebdea34aaeaedb0c0f7861038e into 93605f22caa460b5319b75b058b5fadd/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/ab1209fe8c8841659e9605dc78f1e554_SeqId_47_ - updating store file list. 2023-11-26 15:54:00,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/ab1209fe8c8841659e9605dc78f1e554_SeqId_47_ into 93605f22caa460b5319b75b058b5fadd/family1 2023-11-26 15:54:00,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__e8faangdpq1tpp90bqvu7dqhf4t86j4rj5o50g4f0q5tdqce38382avl7n3j0iut/family1/ababb2ebdea34aaeaedb0c0f7861038e into 93605f22caa460b5319b75b058b5fadd/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/ab1209fe8c8841659e9605dc78f1e554_SeqId_47_) 2023-11-26 15:54:00,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithWeeklyPolicy__e8faangdpq1tpp90bqvu7dqhf4t86j4rj5o50g4f0q5tdqce38382avl7n3j0iut/family1/ababb2ebdea34aaeaedb0c0f7861038e 2023-11-26 15:54:00,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-26 15:54:00,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-26 15:54:00,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(1912): 93605f22caa460b5319b75b058b5fadd/family1 is initiating minor compaction (all files) 2023-11-26 15:54:00,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@15a372aa; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:54:00,671 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 93605f22caa460b5319b75b058b5fadd/family1 in testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:54:00,671 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/9b418e3ead8d45b5aeeb4314679f05c3, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/fef3e2850b604540867a1a0f83bed9b3, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/ab1209fe8c8841659e9605dc78f1e554_SeqId_47_] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp, totalSize=176.8 K 2023-11-26 15:54:00,672 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 9b418e3ead8d45b5aeeb4314679f05c3, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823935 2023-11-26 15:54:00,672 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting fef3e2850b604540867a1a0f83bed9b3, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223935 2023-11-26 15:54:00,673 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting ab1209fe8c8841659e9605dc78f1e554_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965223935 2023-11-26 15:54:00,673 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-26 15:54:00,674 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:00,676 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201ab660e4c2dd94e5bb13b78fdb6ef0f12 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201ab660e4c2dd94e5bb13b78fdb6ef0f12 2023-11-26 15:54:00,678 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512052926a1d1534545ef89b4a9fa12be7658 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512052926a1d1534545ef89b4a9fa12be7658 2023-11-26 15:54:00,678 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-11-26 15:54:00,678 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-26 15:54:00,678 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-26 15:54:00,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-26 15:54:00,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:54:00,680 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-26 15:54:00,682 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4330 sec 2023-11-26 15:54:00,693 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] throttle.PressureAwareThroughputController(145): 93605f22caa460b5319b75b058b5fadd#family1#compaction#35 average throughput is 14.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:54:00,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/1bcfa85a7dff4505b894d609568c39b6, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/ae333a041ce7420182f293a539e984f8, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/287e4dcad64b4dbb9b07500db3600857, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/0dacca379df94af5a6b567027d8b218a, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/07f18168a19144faac545504dd076dd0, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/e588783674e14f60ab05393ed18a16bb, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/2eb4664a66224ce9b8e5ff744de1495d, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/54c251d5a8804c1cb936b72b968879af, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/50c1b4ee019e4f49b23735dc18f12ec2, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/49e09319d8fa4eba8816cf401b6d789c_SeqId_44_] to archive 2023-11-26 15:54:00,723 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:00,725 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/1bcfa85a7dff4505b894d609568c39b6 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/1bcfa85a7dff4505b894d609568c39b6 2023-11-26 15:54:00,727 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/ae333a041ce7420182f293a539e984f8 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/ae333a041ce7420182f293a539e984f8 2023-11-26 15:54:00,728 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/287e4dcad64b4dbb9b07500db3600857 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/287e4dcad64b4dbb9b07500db3600857 2023-11-26 15:54:00,729 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/0dacca379df94af5a6b567027d8b218a to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/0dacca379df94af5a6b567027d8b218a 2023-11-26 15:54:00,731 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/07f18168a19144faac545504dd076dd0 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/07f18168a19144faac545504dd076dd0 2023-11-26 15:54:00,732 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/e588783674e14f60ab05393ed18a16bb to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/e588783674e14f60ab05393ed18a16bb 2023-11-26 15:54:00,733 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/2eb4664a66224ce9b8e5ff744de1495d to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/2eb4664a66224ce9b8e5ff744de1495d 2023-11-26 15:54:00,734 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/54c251d5a8804c1cb936b72b968879af to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/54c251d5a8804c1cb936b72b968879af 2023-11-26 15:54:00,736 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/50c1b4ee019e4f49b23735dc18f12ec2 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/50c1b4ee019e4f49b23735dc18f12ec2 2023-11-26 15:54:00,738 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/49e09319d8fa4eba8816cf401b6d789c_SeqId_44_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/49e09319d8fa4eba8816cf401b6d789c_SeqId_44_ 2023-11-26 15:54:00,785 INFO [Listener at localhost/43645] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=256 (was 258), OpenFileDescriptor=622 (was 634), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=254 (was 288), ProcessCount=171 (was 171), AvailableMemoryMB=8424 (was 8548) 2023-11-26 15:54:00,796 INFO [Listener at localhost/43645] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=256, OpenFileDescriptor=622, MaxFileDescriptor=60000, SystemLoadAverage=254, ProcessCount=171, AvailableMemoryMB=8424 2023-11-26 15:54:00,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-26 15:54:00,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:00,801 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-11-26 15:54:00,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-11-26 15:54:00,802 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-26 15:54:00,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-26 15:54:00,804 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c441d3c84d384c985b934cd76f2ad1fc 2023-11-26 15:54:00,804 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/75e619b545bc7cbd3a56d0999f629da2 2023-11-26 15:54:00,804 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233 2023-11-26 15:54:00,805 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c441d3c84d384c985b934cd76f2ad1fc empty. 2023-11-26 15:54:00,805 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/75e619b545bc7cbd3a56d0999f629da2 empty. 2023-11-26 15:54:00,805 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233 empty. 2023-11-26 15:54:00,805 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c441d3c84d384c985b934cd76f2ad1fc 2023-11-26 15:54:00,805 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/75e619b545bc7cbd3a56d0999f629da2 2023-11-26 15:54:00,805 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233 2023-11-26 15:54:00,805 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-11-26 15:54:00,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-26 15:54:01,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-26 15:54:01,214 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-11-26 15:54:01,216 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 8f44376928d5389e178e37d6e9572233, NAME => 'testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:54:01,216 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => c441d3c84d384c985b934cd76f2ad1fc, NAME => 'testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:54:01,216 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 75e619b545bc7cbd3a56d0999f629da2, NAME => 'testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:54:01,238 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:01,238 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 75e619b545bc7cbd3a56d0999f629da2, disabling compactions & flushes 2023-11-26 15:54:01,238 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2. 2023-11-26 15:54:01,238 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2. 2023-11-26 15:54:01,238 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2. after waiting 0 ms 2023-11-26 15:54:01,238 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2. 2023-11-26 15:54:01,238 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2. 2023-11-26 15:54:01,238 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 75e619b545bc7cbd3a56d0999f629da2: 2023-11-26 15:54:01,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-26 15:54:01,633 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:01,633 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 8f44376928d5389e178e37d6e9572233, disabling compactions & flushes 2023-11-26 15:54:01,633 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. 2023-11-26 15:54:01,633 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. 2023-11-26 15:54:01,633 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. after waiting 0 ms 2023-11-26 15:54:01,633 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. 2023-11-26 15:54:01,633 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. 2023-11-26 15:54:01,633 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 8f44376928d5389e178e37d6e9572233: 2023-11-26 15:54:01,633 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:01,633 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing c441d3c84d384c985b934cd76f2ad1fc, disabling compactions & flushes 2023-11-26 15:54:01,633 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc. 2023-11-26 15:54:01,634 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc. 2023-11-26 15:54:01,634 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc. after waiting 0 ms 2023-11-26 15:54:01,634 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc. 2023-11-26 15:54:01,634 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc. 2023-11-26 15:54:01,634 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for c441d3c84d384c985b934cd76f2ad1fc: 2023-11-26 15:54:01,636 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-11-26 15:54:01,637 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1701014041637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014041637"}]},"ts":"1701014041637"} 2023-11-26 15:54:01,637 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701014041637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014041637"}]},"ts":"1701014041637"} 2023-11-26 15:54:01,638 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701014041637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014041637"}]},"ts":"1701014041637"} 2023-11-26 15:54:01,641 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-26 15:54:01,642 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-26 15:54:01,642 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014041642"}]},"ts":"1701014041642"} 2023-11-26 15:54:01,643 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-11-26 15:54:01,648 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c441d3c84d384c985b934cd76f2ad1fc, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=75e619b545bc7cbd3a56d0999f629da2, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8f44376928d5389e178e37d6e9572233, ASSIGN}] 2023-11-26 15:54:01,650 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=75e619b545bc7cbd3a56d0999f629da2, ASSIGN 2023-11-26 15:54:01,650 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c441d3c84d384c985b934cd76f2ad1fc, ASSIGN 2023-11-26 15:54:01,650 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8f44376928d5389e178e37d6e9572233, ASSIGN 2023-11-26 15:54:01,651 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=75e619b545bc7cbd3a56d0999f629da2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:54:01,651 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8f44376928d5389e178e37d6e9572233, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:54:01,651 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c441d3c84d384c985b934cd76f2ad1fc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:54:01,802 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c441d3c84d384c985b934cd76f2ad1fc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:01,802 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=75e619b545bc7cbd3a56d0999f629da2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:01,802 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=8f44376928d5389e178e37d6e9572233, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:01,803 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701014041802"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014041802"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014041802"}]},"ts":"1701014041802"} 2023-11-26 15:54:01,803 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1701014041802"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014041802"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014041802"}]},"ts":"1701014041802"} 2023-11-26 15:54:01,803 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701014041802"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014041802"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014041802"}]},"ts":"1701014041802"} 2023-11-26 15:54:01,804 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure c441d3c84d384c985b934cd76f2ad1fc, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:54:01,805 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=29, state=RUNNABLE; OpenRegionProcedure 75e619b545bc7cbd3a56d0999f629da2, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:54:01,806 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure 8f44376928d5389e178e37d6e9572233, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:54:01,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-26 15:54:01,916 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/.tmp/family1/595e4f3544f34b158c49ece09f49f621 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/595e4f3544f34b158c49ece09f49f621 2023-11-26 15:54:01,921 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 93605f22caa460b5319b75b058b5fadd/family1 of 93605f22caa460b5319b75b058b5fadd into 595e4f3544f34b158c49ece09f49f621(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-26 15:54:01,921 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 93605f22caa460b5319b75b058b5fadd: 2023-11-26 15:54:01,921 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1701014040671; duration=1sec 2023-11-26 15:54:01,921 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:54:01,957 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:01,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2. 2023-11-26 15:54:01,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 75e619b545bc7cbd3a56d0999f629da2, NAME => 'testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2.', STARTKEY => '1', ENDKEY => '2'} 2023-11-26 15:54:01,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 75e619b545bc7cbd3a56d0999f629da2 2023-11-26 15:54:01,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:01,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 75e619b545bc7cbd3a56d0999f629da2 2023-11-26 15:54:01,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 75e619b545bc7cbd3a56d0999f629da2 2023-11-26 15:54:01,963 INFO [StoreOpener-75e619b545bc7cbd3a56d0999f629da2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 75e619b545bc7cbd3a56d0999f629da2 2023-11-26 15:54:01,964 DEBUG [StoreOpener-75e619b545bc7cbd3a56d0999f629da2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/75e619b545bc7cbd3a56d0999f629da2/family1 2023-11-26 15:54:01,964 DEBUG [StoreOpener-75e619b545bc7cbd3a56d0999f629da2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/75e619b545bc7cbd3a56d0999f629da2/family1 2023-11-26 15:54:01,965 INFO [StoreOpener-75e619b545bc7cbd3a56d0999f629da2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75e619b545bc7cbd3a56d0999f629da2 columnFamilyName family1 2023-11-26 15:54:01,966 INFO [StoreOpener-75e619b545bc7cbd3a56d0999f629da2-1] regionserver.HStore(310): Store=75e619b545bc7cbd3a56d0999f629da2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:54:01,967 INFO [StoreOpener-75e619b545bc7cbd3a56d0999f629da2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 75e619b545bc7cbd3a56d0999f629da2 2023-11-26 15:54:01,968 DEBUG [StoreOpener-75e619b545bc7cbd3a56d0999f629da2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/75e619b545bc7cbd3a56d0999f629da2/family2 2023-11-26 15:54:01,968 DEBUG [StoreOpener-75e619b545bc7cbd3a56d0999f629da2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/75e619b545bc7cbd3a56d0999f629da2/family2 2023-11-26 15:54:01,968 INFO [StoreOpener-75e619b545bc7cbd3a56d0999f629da2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 75e619b545bc7cbd3a56d0999f629da2 columnFamilyName family2 2023-11-26 15:54:01,969 INFO [StoreOpener-75e619b545bc7cbd3a56d0999f629da2-1] regionserver.HStore(310): Store=75e619b545bc7cbd3a56d0999f629da2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:54:01,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/75e619b545bc7cbd3a56d0999f629da2 2023-11-26 15:54:01,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/75e619b545bc7cbd3a56d0999f629da2 2023-11-26 15:54:01,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-26 15:54:01,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 75e619b545bc7cbd3a56d0999f629da2 2023-11-26 15:54:01,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/75e619b545bc7cbd3a56d0999f629da2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:54:01,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 75e619b545bc7cbd3a56d0999f629da2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69773055, jitterRate=0.03969953954219818}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-26 15:54:01,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 75e619b545bc7cbd3a56d0999f629da2: 2023-11-26 15:54:01,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2., pid=32, masterSystemTime=1701014041957 2023-11-26 15:54:01,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2. 2023-11-26 15:54:01,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2. 2023-11-26 15:54:01,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc. 2023-11-26 15:54:01,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c441d3c84d384c985b934cd76f2ad1fc, NAME => 'testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc.', STARTKEY => '', ENDKEY => '1'} 2023-11-26 15:54:01,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles c441d3c84d384c985b934cd76f2ad1fc 2023-11-26 15:54:01,980 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=75e619b545bc7cbd3a56d0999f629da2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:01,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:01,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c441d3c84d384c985b934cd76f2ad1fc 2023-11-26 15:54:01,980 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1701014041980"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014041980"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014041980"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014041980"}]},"ts":"1701014041980"} 2023-11-26 15:54:01,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c441d3c84d384c985b934cd76f2ad1fc 2023-11-26 15:54:01,982 INFO [StoreOpener-c441d3c84d384c985b934cd76f2ad1fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c441d3c84d384c985b934cd76f2ad1fc 2023-11-26 15:54:01,983 DEBUG [StoreOpener-c441d3c84d384c985b934cd76f2ad1fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/c441d3c84d384c985b934cd76f2ad1fc/family1 2023-11-26 15:54:01,984 DEBUG [StoreOpener-c441d3c84d384c985b934cd76f2ad1fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/c441d3c84d384c985b934cd76f2ad1fc/family1 2023-11-26 15:54:01,984 INFO [StoreOpener-c441d3c84d384c985b934cd76f2ad1fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c441d3c84d384c985b934cd76f2ad1fc columnFamilyName family1 2023-11-26 15:54:01,985 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=32, resume processing ppid=29 2023-11-26 15:54:01,985 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=29, state=SUCCESS; OpenRegionProcedure 75e619b545bc7cbd3a56d0999f629da2, server=jenkins-hbase4.apache.org,41861,1701014000937 in 177 msec 2023-11-26 15:54:01,985 INFO [StoreOpener-c441d3c84d384c985b934cd76f2ad1fc-1] regionserver.HStore(310): Store=c441d3c84d384c985b934cd76f2ad1fc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:54:01,985 INFO [StoreOpener-c441d3c84d384c985b934cd76f2ad1fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c441d3c84d384c985b934cd76f2ad1fc 2023-11-26 15:54:01,986 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=75e619b545bc7cbd3a56d0999f629da2, ASSIGN in 337 msec 2023-11-26 15:54:01,987 DEBUG [StoreOpener-c441d3c84d384c985b934cd76f2ad1fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/c441d3c84d384c985b934cd76f2ad1fc/family2 2023-11-26 15:54:01,987 DEBUG [StoreOpener-c441d3c84d384c985b934cd76f2ad1fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/c441d3c84d384c985b934cd76f2ad1fc/family2 2023-11-26 15:54:01,988 INFO [StoreOpener-c441d3c84d384c985b934cd76f2ad1fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c441d3c84d384c985b934cd76f2ad1fc columnFamilyName family2 2023-11-26 15:54:01,989 INFO [StoreOpener-c441d3c84d384c985b934cd76f2ad1fc-1] regionserver.HStore(310): Store=c441d3c84d384c985b934cd76f2ad1fc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:54:01,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/c441d3c84d384c985b934cd76f2ad1fc 2023-11-26 15:54:01,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/c441d3c84d384c985b934cd76f2ad1fc 2023-11-26 15:54:01,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-26 15:54:01,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c441d3c84d384c985b934cd76f2ad1fc 2023-11-26 15:54:01,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/c441d3c84d384c985b934cd76f2ad1fc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:54:01,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c441d3c84d384c985b934cd76f2ad1fc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70094123, jitterRate=0.04448382556438446}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-26 15:54:01,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c441d3c84d384c985b934cd76f2ad1fc: 2023-11-26 15:54:01,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc., pid=31, masterSystemTime=1701014041957 2023-11-26 15:54:01,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc. 2023-11-26 15:54:01,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc. 2023-11-26 15:54:01,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. 2023-11-26 15:54:01,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8f44376928d5389e178e37d6e9572233, NAME => 'testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233.', STARTKEY => '2', ENDKEY => ''} 2023-11-26 15:54:01,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 8f44376928d5389e178e37d6e9572233 2023-11-26 15:54:01,998 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c441d3c84d384c985b934cd76f2ad1fc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:01,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:01,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8f44376928d5389e178e37d6e9572233 2023-11-26 15:54:01,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8f44376928d5389e178e37d6e9572233 2023-11-26 15:54:01,999 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701014041998"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014041998"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014041998"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014041998"}]},"ts":"1701014041998"} 2023-11-26 15:54:02,000 INFO [StoreOpener-8f44376928d5389e178e37d6e9572233-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8f44376928d5389e178e37d6e9572233 2023-11-26 15:54:02,001 DEBUG [StoreOpener-8f44376928d5389e178e37d6e9572233-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1 2023-11-26 15:54:02,001 DEBUG [StoreOpener-8f44376928d5389e178e37d6e9572233-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1 2023-11-26 15:54:02,002 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=31, resume processing ppid=28 2023-11-26 15:54:02,002 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure c441d3c84d384c985b934cd76f2ad1fc, server=jenkins-hbase4.apache.org,41861,1701014000937 in 196 msec 2023-11-26 15:54:02,002 INFO [StoreOpener-8f44376928d5389e178e37d6e9572233-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f44376928d5389e178e37d6e9572233 columnFamilyName family1 2023-11-26 15:54:02,003 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c441d3c84d384c985b934cd76f2ad1fc, ASSIGN in 354 msec 2023-11-26 15:54:02,003 INFO [StoreOpener-8f44376928d5389e178e37d6e9572233-1] regionserver.HStore(310): Store=8f44376928d5389e178e37d6e9572233/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:54:02,003 INFO [StoreOpener-8f44376928d5389e178e37d6e9572233-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8f44376928d5389e178e37d6e9572233 2023-11-26 15:54:02,004 DEBUG [StoreOpener-8f44376928d5389e178e37d6e9572233-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family2 2023-11-26 15:54:02,005 DEBUG [StoreOpener-8f44376928d5389e178e37d6e9572233-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family2 2023-11-26 15:54:02,005 INFO [StoreOpener-8f44376928d5389e178e37d6e9572233-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f44376928d5389e178e37d6e9572233 columnFamilyName family2 2023-11-26 15:54:02,006 INFO [StoreOpener-8f44376928d5389e178e37d6e9572233-1] regionserver.HStore(310): Store=8f44376928d5389e178e37d6e9572233/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:54:02,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233 2023-11-26 15:54:02,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233 2023-11-26 15:54:02,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-26 15:54:02,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8f44376928d5389e178e37d6e9572233 2023-11-26 15:54:02,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:54:02,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8f44376928d5389e178e37d6e9572233; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67313379, jitterRate=0.0030475109815597534}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-26 15:54:02,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8f44376928d5389e178e37d6e9572233: 2023-11-26 15:54:02,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233., pid=33, masterSystemTime=1701014041957 2023-11-26 15:54:02,018 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/9b418e3ead8d45b5aeeb4314679f05c3, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/fef3e2850b604540867a1a0f83bed9b3, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/ab1209fe8c8841659e9605dc78f1e554_SeqId_47_] to archive 2023-11-26 15:54:02,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. 2023-11-26 15:54:02,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. 2023-11-26 15:54:02,019 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:02,019 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=8f44376928d5389e178e37d6e9572233, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:02,020 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701014042019"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014042019"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014042019"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014042019"}]},"ts":"1701014042019"} 2023-11-26 15:54:02,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/9b418e3ead8d45b5aeeb4314679f05c3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/9b418e3ead8d45b5aeeb4314679f05c3 2023-11-26 15:54:02,023 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/fef3e2850b604540867a1a0f83bed9b3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/fef3e2850b604540867a1a0f83bed9b3 2023-11-26 15:54:02,023 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=33, resume processing ppid=30 2023-11-26 15:54:02,023 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure 8f44376928d5389e178e37d6e9572233, server=jenkins-hbase4.apache.org,41861,1701014000937 in 215 msec 2023-11-26 15:54:02,025 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/ab1209fe8c8841659e9605dc78f1e554_SeqId_47_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/family1/ab1209fe8c8841659e9605dc78f1e554_SeqId_47_ 2023-11-26 15:54:02,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=30, resume processing ppid=27 2023-11-26 15:54:02,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8f44376928d5389e178e37d6e9572233, ASSIGN in 375 msec 2023-11-26 15:54:02,027 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-26 15:54:02,027 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014042027"}]},"ts":"1701014042027"} 2023-11-26 15:54:02,029 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-11-26 15:54:02,032 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-11-26 15:54:02,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2340 sec 2023-11-26 15:54:02,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-26 15:54:02,908 INFO [Listener at localhost/43645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-11-26 15:54:02,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:02,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,917 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-26 15:54:02,917 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:02,917 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-26 15:54:02,917 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-26 15:54:02,917 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,918 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,919 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:02,919 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:02,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:02,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:02,919 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:02,919 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:02,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,920 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:02,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,920 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,920 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,921 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-26 15:54:02,921 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:02,921 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-26 15:54:02,921 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc. 2023-11-26 15:54:02,921 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc. started... 2023-11-26 15:54:02,921 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. 2023-11-26 15:54:02,921 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-26 15:54:02,922 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:02,922 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c441d3c84d384c985b934cd76f2ad1fc: 2023-11-26 15:54:02,922 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2. 2023-11-26 15:54:02,922 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2. started... 2023-11-26 15:54:02,921 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. started... 2023-11-26 15:54:02,922 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc. 2023-11-26 15:54:02,923 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-26 15:54:02,923 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8f44376928d5389e178e37d6e9572233 2/2 column families, dataSize=48 B heapSize=632 B 2023-11-26 15:54:02,923 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 75e619b545bc7cbd3a56d0999f629da2: 2023-11-26 15:54:02,923 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2. 2023-11-26 15:54:02,923 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-26 15:54:02,936 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126ce56b072dfc244899e0a7103a2a1e2b4 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231126ce56b072dfc244899e0a7103a2a1e2b4 2023-11-26 15:54:02,941 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/.tmp/family1/2b8b0a8ba6da4488a806b095af2a44a3 2023-11-26 15:54:02,945 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/.tmp/family1/2b8b0a8ba6da4488a806b095af2a44a3 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/2b8b0a8ba6da4488a806b095af2a44a3 2023-11-26 15:54:02,949 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/2b8b0a8ba6da4488a806b095af2a44a3, entries=1, sequenceid=5, filesize=4.9 K 2023-11-26 15:54:02,950 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 8f44376928d5389e178e37d6e9572233 in 27ms, sequenceid=5, compaction requested=false 2023-11-26 15:54:02,950 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-26 15:54:02,950 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8f44376928d5389e178e37d6e9572233: 2023-11-26 15:54:02,950 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. 2023-11-26 15:54:02,951 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-26 15:54:02,951 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-26 15:54:02,951 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:02,951 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-26 15:54:02,951 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-26 15:54:02,952 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,952 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:02,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:02,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:02,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:02,953 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,953 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:02,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:02,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:02,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:02,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:02,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-26 15:54:02,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78a14a2f[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:02,954 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-26 15:54:02,954 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,960 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,960 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-26 15:54:02,960 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-26 15:54:02,960 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:02,960 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:02,960 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:02,961 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-26 15:54:02,961 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:02,962 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:02,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:02,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:02,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:02,962 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-26 15:54:02,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:02,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:02,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:02,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:02,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:02,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:02,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-26 15:54:02,964 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-26 15:54:02,964 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:02,964 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:02,964 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,964 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:02,966 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,966 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:02,966 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:02,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:02,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:02,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:02,967 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:02,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:02,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:02,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:02,968 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:02,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:02,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:02,970 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:02,970 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:02,970 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,970 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:02,970 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-26 15:54:02,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:02,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:02,970 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:02,971 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:02,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-26 15:54:02,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:02,971 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,971 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,971 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:02,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:02,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:02,971 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:02,971 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:03,071 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:03,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:03,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:03,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:03,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,078 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-26 15:54:03,078 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:03,078 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-26 15:54:03,078 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-26 15:54:03,079 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,079 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,082 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:03,082 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:03,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:03,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:03,082 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:03,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,082 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:03,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:03,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,083 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,083 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-11-26 15:54:03,083 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,083 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-26 15:54:03,083 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:03,083 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-26 15:54:03,085 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc. 2023-11-26 15:54:03,085 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. 2023-11-26 15:54:03,086 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-26 15:54:03,086 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2. 2023-11-26 15:54:03,085 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc. started... 2023-11-26 15:54:03,086 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2. started... 2023-11-26 15:54:03,086 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:03,086 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c441d3c84d384c985b934cd76f2ad1fc: 2023-11-26 15:54:03,086 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. started... 2023-11-26 15:54:03,086 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc. 2023-11-26 15:54:03,086 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 75e619b545bc7cbd3a56d0999f629da2: 2023-11-26 15:54:03,086 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 8f44376928d5389e178e37d6e9572233 2/2 column families, dataSize=90 B heapSize=752 B 2023-11-26 15:54:03,086 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-26 15:54:03,086 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2. 2023-11-26 15:54:03,086 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-26 15:54:03,502 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311264fbbf8375268499a9eae8ac0b4eeaf2f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311264fbbf8375268499a9eae8ac0b4eeaf2f 2023-11-26 15:54:03,908 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/.tmp/family1/a6763f30db0948f8922922dc44463dde 2023-11-26 15:54:03,914 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/.tmp/family1/a6763f30db0948f8922922dc44463dde as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/a6763f30db0948f8922922dc44463dde 2023-11-26 15:54:03,919 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/a6763f30db0948f8922922dc44463dde, entries=2, sequenceid=9, filesize=5.0 K 2023-11-26 15:54:03,920 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 8f44376928d5389e178e37d6e9572233 in 834ms, sequenceid=9, compaction requested=false 2023-11-26 15:54:03,920 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 8f44376928d5389e178e37d6e9572233: 2023-11-26 15:54:03,920 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. 2023-11-26 15:54:03,920 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-26 15:54:03,921 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-26 15:54:03,921 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:03,921 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-26 15:54:03,921 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-26 15:54:03,922 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:03,922 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:03,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:03,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:03,923 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,923 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:03,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:03,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:03,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:03,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:03,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-26 15:54:03,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@224b092b[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:03,925 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-26 15:54:03,925 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,926 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,926 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-26 15:54:03,926 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:03,926 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:03,926 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-26 15:54:03,926 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:03,928 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-26 15:54:03,928 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:03,928 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:03,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:03,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:03,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:03,928 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-26 15:54:03,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:03,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:03,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-26 15:54:03,930 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-26 15:54:03,930 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:03,930 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:03,930 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,930 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:03,935 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,935 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:03,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:03,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,935 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:03,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:03,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:03,936 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:03,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:03,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:03,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:03,937 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:03,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:03,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:03,940 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:03,940 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,940 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:03,940 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:03,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-26 15:54:03,940 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:03,940 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:03,940 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:03,940 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:03,940 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:03,940 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,940 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:03,940 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:03,940 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:03,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:03,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:04,040 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:04,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:04,049 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33415] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-11-26 15:54:04,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-26 15:54:04,051 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-26 15:54:04,052 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701014644052 2023-11-26 15:54:04,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:54:04,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-26 15:54:04,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-11-26 15:54:04,054 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-26 15:54:04,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] zookeeper.ReadOnlyZKClient(139): Connect 0x698476f0 to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:54:04,060 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4167b6ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:54:04,060 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231126 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-26 15:54:04,887 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112690c5144c909d464e8010720d2ab739a2 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023112690c5144c909d464e8010720d2ab739a2 2023-11-26 15:54:04,888 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231126 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-26 15:54:04,902 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:54:04,903 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:54:04,911 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-26 15:54:04,913 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-26 15:54:04,928 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231126/family1/f05c14f342904f939290a9153635bedf first=Optional[k0] last=Optional[k1] 2023-11-26 15:54:04,929 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231126/family1/f05c14f342904f939290a9153635bedf}] 2023-11-26 15:54:04,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231126/family1/f05c14f342904f939290a9153635bedf for inclusion in 8f44376928d5389e178e37d6e9572233/family1 2023-11-26 15:54:04,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-11-26 15:54:04,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-26 15:54:04,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for 8f44376928d5389e178e37d6e9572233: 2023-11-26 15:54:04,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231126/family1/f05c14f342904f939290a9153635bedf to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testScannerOnBulkLoadRefHFiles__m6o9ee9apnb1jh6b4d42aqj5m5fdtdtmf4oj8113oghgisrdkm99eu795cmct9sv/family1/f05c14f342904f939290a9153635bedf 2023-11-26 15:54:04,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testScannerOnBulkLoadRefHFiles__m6o9ee9apnb1jh6b4d42aqj5m5fdtdtmf4oj8113oghgisrdkm99eu795cmct9sv/family1/f05c14f342904f939290a9153635bedf as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/0f1c413887be4616a68b88e1c3e9c811_SeqId_12_ 2023-11-26 15:54:04,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testScannerOnBulkLoadRefHFiles__m6o9ee9apnb1jh6b4d42aqj5m5fdtdtmf4oj8113oghgisrdkm99eu795cmct9sv/family1/f05c14f342904f939290a9153635bedf into 8f44376928d5389e178e37d6e9572233/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/0f1c413887be4616a68b88e1c3e9c811_SeqId_12_ - updating store file list. 2023-11-26 15:54:04,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/0f1c413887be4616a68b88e1c3e9c811_SeqId_12_ into 8f44376928d5389e178e37d6e9572233/family1 2023-11-26 15:54:04,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testScannerOnBulkLoadRefHFiles__m6o9ee9apnb1jh6b4d42aqj5m5fdtdtmf4oj8113oghgisrdkm99eu795cmct9sv/family1/f05c14f342904f939290a9153635bedf into 8f44376928d5389e178e37d6e9572233/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/0f1c413887be4616a68b88e1c3e9c811_SeqId_12_) 2023-11-26 15:54:04,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testScannerOnBulkLoadRefHFiles__m6o9ee9apnb1jh6b4d42aqj5m5fdtdtmf4oj8113oghgisrdkm99eu795cmct9sv/family1/f05c14f342904f939290a9153635bedf 2023-11-26 15:54:04,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-26 15:54:04,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-26 15:54:04,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(1912): 8f44376928d5389e178e37d6e9572233/family1 is initiating minor compaction (all files) 2023-11-26 15:54:04,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@51862d19; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:54:04,951 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8f44376928d5389e178e37d6e9572233/family1 in testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. 2023-11-26 15:54:04,951 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/2b8b0a8ba6da4488a806b095af2a44a3, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/a6763f30db0948f8922922dc44463dde, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/0f1c413887be4616a68b88e1c3e9c811_SeqId_12_] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/.tmp, totalSize=15.1 K 2023-11-26 15:54:04,952 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 2b8b0a8ba6da4488a806b095af2a44a3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014042909 2023-11-26 15:54:04,953 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting a6763f30db0948f8922922dc44463dde, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014042909 2023-11-26 15:54:04,954 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 0f1c413887be4616a68b88e1c3e9c811_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014042909 2023-11-26 15:54:04,955 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231126 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-26 15:54:04,956 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:04,958 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311264fbbf8375268499a9eae8ac0b4eeaf2f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311264fbbf8375268499a9eae8ac0b4eeaf2f 2023-11-26 15:54:04,960 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231126ce56b072dfc244899e0a7103a2a1e2b4 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231126ce56b072dfc244899e0a7103a2a1e2b4 2023-11-26 15:54:04,960 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-11-26 15:54:04,960 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231126' 2023-11-26 15:54:04,961 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231126 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-26 15:54:04,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-26 15:54:04,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:54:04,962 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-26 15:54:04,964 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 912 msec 2023-11-26 15:54:04,966 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8f44376928d5389e178e37d6e9572233#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:54:05,000 INFO [Listener at localhost/43645] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=255 (was 256), OpenFileDescriptor=631 (was 622) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=254 (was 254), ProcessCount=171 (was 171), AvailableMemoryMB=8422 (was 8424) 2023-11-26 15:54:05,012 INFO [Listener at localhost/43645] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=255, OpenFileDescriptor=631, MaxFileDescriptor=60000, SystemLoadAverage=254, ProcessCount=171, AvailableMemoryMB=8422 2023-11-26 15:54:05,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-26 15:54:05,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:05,017 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-26 15:54:05,017 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-11-26 15:54:05,018 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-26 15:54:05,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-26 15:54:05,019 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931 2023-11-26 15:54:05,020 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931 empty. 2023-11-26 15:54:05,020 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931 2023-11-26 15:54:05,020 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-11-26 15:54:05,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-26 15:54:05,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-26 15:54:05,430 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-26 15:54:05,431 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4cfb0cd6c51e1e07ae54d6cd68e75931, NAME => 'testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:54:05,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-26 15:54:05,838 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:05,838 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 4cfb0cd6c51e1e07ae54d6cd68e75931, disabling compactions & flushes 2023-11-26 15:54:05,838 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:05,838 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:05,838 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. after waiting 0 ms 2023-11-26 15:54:05,838 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:05,838 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:05,838 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 4cfb0cd6c51e1e07ae54d6cd68e75931: 2023-11-26 15:54:05,840 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-26 15:54:05,841 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701014045841"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014045841"}]},"ts":"1701014045841"} 2023-11-26 15:54:05,843 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-26 15:54:05,844 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-26 15:54:05,844 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014045844"}]},"ts":"1701014045844"} 2023-11-26 15:54:05,845 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-26 15:54:05,848 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=4cfb0cd6c51e1e07ae54d6cd68e75931, ASSIGN}] 2023-11-26 15:54:05,849 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=4cfb0cd6c51e1e07ae54d6cd68e75931, ASSIGN 2023-11-26 15:54:05,850 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=4cfb0cd6c51e1e07ae54d6cd68e75931, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:54:06,001 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=4cfb0cd6c51e1e07ae54d6cd68e75931, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:06,001 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701014046001"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014046001"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014046001"}]},"ts":"1701014046001"} 2023-11-26 15:54:06,003 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 4cfb0cd6c51e1e07ae54d6cd68e75931, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:54:06,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-26 15:54:06,155 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:06,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:06,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4cfb0cd6c51e1e07ae54d6cd68e75931, NAME => 'testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931.', STARTKEY => '', ENDKEY => ''} 2023-11-26 15:54:06,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 4cfb0cd6c51e1e07ae54d6cd68e75931 2023-11-26 15:54:06,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:06,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4cfb0cd6c51e1e07ae54d6cd68e75931 2023-11-26 15:54:06,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4cfb0cd6c51e1e07ae54d6cd68e75931 2023-11-26 15:54:06,160 INFO [StoreOpener-4cfb0cd6c51e1e07ae54d6cd68e75931-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4cfb0cd6c51e1e07ae54d6cd68e75931 2023-11-26 15:54:06,162 DEBUG [StoreOpener-4cfb0cd6c51e1e07ae54d6cd68e75931-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1 2023-11-26 15:54:06,162 DEBUG [StoreOpener-4cfb0cd6c51e1e07ae54d6cd68e75931-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1 2023-11-26 15:54:06,162 INFO [StoreOpener-4cfb0cd6c51e1e07ae54d6cd68e75931-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4cfb0cd6c51e1e07ae54d6cd68e75931 columnFamilyName family1 2023-11-26 15:54:06,164 INFO [StoreOpener-4cfb0cd6c51e1e07ae54d6cd68e75931-1] regionserver.HStore(310): Store=4cfb0cd6c51e1e07ae54d6cd68e75931/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:54:06,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931 2023-11-26 15:54:06,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931 2023-11-26 15:54:06,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4cfb0cd6c51e1e07ae54d6cd68e75931 2023-11-26 15:54:06,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:54:06,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4cfb0cd6c51e1e07ae54d6cd68e75931; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66254333, jitterRate=-0.012733504176139832}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-26 15:54:06,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4cfb0cd6c51e1e07ae54d6cd68e75931: 2023-11-26 15:54:06,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931., pid=37, masterSystemTime=1701014046155 2023-11-26 15:54:06,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:06,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:06,173 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=4cfb0cd6c51e1e07ae54d6cd68e75931, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:06,174 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701014046173"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014046173"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014046173"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014046173"}]},"ts":"1701014046173"} 2023-11-26 15:54:06,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=37, resume processing ppid=36 2023-11-26 15:54:06,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 4cfb0cd6c51e1e07ae54d6cd68e75931, server=jenkins-hbase4.apache.org,41861,1701014000937 in 172 msec 2023-11-26 15:54:06,179 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=36, resume processing ppid=35 2023-11-26 15:54:06,179 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=4cfb0cd6c51e1e07ae54d6cd68e75931, ASSIGN in 329 msec 2023-11-26 15:54:06,180 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-26 15:54:06,180 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014046180"}]},"ts":"1701014046180"} 2023-11-26 15:54:06,181 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-26 15:54:06,184 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-26 15:54:06,186 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1690 sec 2023-11-26 15:54:06,187 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/.tmp/family1/5f6af1b92ded42b28f4050a5d27c9e99 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/5f6af1b92ded42b28f4050a5d27c9e99 2023-11-26 15:54:06,193 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 8f44376928d5389e178e37d6e9572233/family1 of 8f44376928d5389e178e37d6e9572233 into 5f6af1b92ded42b28f4050a5d27c9e99(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-26 15:54:06,193 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8f44376928d5389e178e37d6e9572233: 2023-11-26 15:54:06,193 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1701014044951; duration=1sec 2023-11-26 15:54:06,193 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:54:06,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/2b8b0a8ba6da4488a806b095af2a44a3, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/a6763f30db0948f8922922dc44463dde, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/0f1c413887be4616a68b88e1c3e9c811_SeqId_12_] to archive 2023-11-26 15:54:06,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:06,226 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/2b8b0a8ba6da4488a806b095af2a44a3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/2b8b0a8ba6da4488a806b095af2a44a3 2023-11-26 15:54:06,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/a6763f30db0948f8922922dc44463dde to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/a6763f30db0948f8922922dc44463dde 2023-11-26 15:54:06,228 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/0f1c413887be4616a68b88e1c3e9c811_SeqId_12_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/family1/0f1c413887be4616a68b88e1c3e9c811_SeqId_12_ 2023-11-26 15:54:07,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-26 15:54:07,124 INFO [Listener at localhost/43645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-11-26 15:54:07,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:07,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:07,148 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:07,148 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:07,148 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-26 15:54:07,148 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-26 15:54:07,149 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:07,149 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:07,155 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:07,155 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:07,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:07,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:07,156 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:07,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:07,156 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:07,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:07,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:07,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:07,156 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:07,157 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:07,157 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-26 15:54:07,157 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:07,157 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-26 15:54:07,157 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:07,157 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:07,157 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:07,157 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. started... 2023-11-26 15:54:07,158 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4cfb0cd6c51e1e07ae54d6cd68e75931 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-26 15:54:07,488 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-26 15:54:07,580 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f764dd92986a4cf7ab66d4123687c005 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130f764dd92986a4cf7ab66d4123687c005 2023-11-26 15:54:07,984 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/c4b54b1d0f184a6994ffbaff088a0782 2023-11-26 15:54:07,990 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/c4b54b1d0f184a6994ffbaff088a0782 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/c4b54b1d0f184a6994ffbaff088a0782 2023-11-26 15:54:07,994 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/c4b54b1d0f184a6994ffbaff088a0782, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-26 15:54:07,995 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 4cfb0cd6c51e1e07ae54d6cd68e75931 in 837ms, sequenceid=5, compaction requested=false 2023-11-26 15:54:07,995 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:07,996 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4cfb0cd6c51e1e07ae54d6cd68e75931: 2023-11-26 15:54:07,996 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:07,996 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:07,996 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:07,996 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:07,996 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-26 15:54:07,996 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-26 15:54:07,998 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:07,998 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:07,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:07,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:07,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:07,998 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:07,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:07,999 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:07,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:07,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:07,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:08,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-26 15:54:08,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f5cbdc9[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:08,000 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-26 15:54:08,000 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,001 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,001 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-26 15:54:08,001 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-26 15:54:08,001 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:08,002 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,002 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:08,003 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,003 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-26 15:54:08,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:08,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:08,003 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:08,003 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-26 15:54:08,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:08,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:08,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:08,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:08,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:54:08,005 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-26 15:54:08,005 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:08,005 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:08,005 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,006 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:08,008 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,008 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:08,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:08,008 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:08,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:08,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:08,008 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:08,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:08,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,010 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:08,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,012 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,012 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,012 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:08,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:08,012 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:08,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:08,012 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:08,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:08,012 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:08,012 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,012 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,013 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,013 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:08,013 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:08,013 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:08,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:08,113 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:08,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:08,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:08,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:08,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,120 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:08,120 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:08,120 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-26 15:54:08,120 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-26 15:54:08,120 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,120 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,122 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,122 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:08,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:08,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:08,122 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,122 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:08,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:08,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,123 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,123 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-26 15:54:08,123 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,123 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-26 15:54:08,123 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:08,123 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-26 15:54:08,123 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:08,123 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:08,123 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:08,123 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. started... 2023-11-26 15:54:08,123 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4cfb0cd6c51e1e07ae54d6cd68e75931 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-26 15:54:08,537 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d15535e3afa24b6b8d83c29dcb7e6165 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128d15535e3afa24b6b8d83c29dcb7e6165 2023-11-26 15:54:08,944 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/de47d9942b2943f5b0fc5bcddaba2c82 2023-11-26 15:54:08,949 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/de47d9942b2943f5b0fc5bcddaba2c82 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/de47d9942b2943f5b0fc5bcddaba2c82 2023-11-26 15:54:08,954 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/de47d9942b2943f5b0fc5bcddaba2c82, entries=1, sequenceid=9, filesize=5.0 K 2023-11-26 15:54:08,955 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 4cfb0cd6c51e1e07ae54d6cd68e75931 in 832ms, sequenceid=9, compaction requested=false 2023-11-26 15:54:08,955 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4cfb0cd6c51e1e07ae54d6cd68e75931: 2023-11-26 15:54:08,955 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:08,955 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:08,955 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:08,955 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,955 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-26 15:54:08,955 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-26 15:54:08,957 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,957 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:08,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:08,957 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,957 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:08,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:08,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:08,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:08,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-26 15:54:08,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@301f26c0[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:08,959 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-26 15:54:08,959 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,961 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,962 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-26 15:54:08,962 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-26 15:54:08,962 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:08,962 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,962 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:08,963 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,963 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-26 15:54:08,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:08,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:08,963 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:08,963 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-26 15:54:08,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:08,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:08,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:08,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:08,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:54:08,966 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-26 15:54:08,966 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:08,966 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:08,966 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,966 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:08,968 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,968 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:08,968 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:08,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:08,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:08,969 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:08,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,970 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:08,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,976 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,976 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:08,976 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:08,976 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:08,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-26 15:54:08,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:08,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:08,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:08,976 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:08,976 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,976 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:08,977 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,977 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,977 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:08,977 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:08,977 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:08,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:08,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:09,077 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:09,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:09,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:09,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:09,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,084 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:09,084 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:09,084 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-26 15:54:09,084 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-26 15:54:09,084 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,084 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,086 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:09,086 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:09,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:09,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:09,086 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:09,086 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:09,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,087 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:09,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,087 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,087 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-26 15:54:09,087 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,087 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-26 15:54:09,087 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:09,088 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-26 15:54:09,088 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:09,088 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:09,088 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:09,088 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. started... 2023-11-26 15:54:09,088 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4cfb0cd6c51e1e07ae54d6cd68e75931 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:09,501 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512016d4a9b773ccb4ed6b21eed50d7a546f7 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512016d4a9b773ccb4ed6b21eed50d7a546f7 2023-11-26 15:54:09,909 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/72a13ddd6dfa42fbb995470fbf7004cf 2023-11-26 15:54:09,914 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/72a13ddd6dfa42fbb995470fbf7004cf as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/72a13ddd6dfa42fbb995470fbf7004cf 2023-11-26 15:54:09,918 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/72a13ddd6dfa42fbb995470fbf7004cf, entries=1, sequenceid=13, filesize=4.9 K 2023-11-26 15:54:09,919 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4cfb0cd6c51e1e07ae54d6cd68e75931 in 831ms, sequenceid=13, compaction requested=true 2023-11-26 15:54:09,919 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4cfb0cd6c51e1e07ae54d6cd68e75931: 2023-11-26 15:54:09,919 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:09,919 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:09,919 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:09,919 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:09,920 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-26 15:54:09,920 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-26 15:54:09,921 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:09,921 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:09,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:09,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:09,922 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,922 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:09,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:09,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:09,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:09,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:09,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-26 15:54:09,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@421de2de[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:09,923 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-26 15:54:09,923 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,925 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,925 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-26 15:54:09,925 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-26 15:54:09,925 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:09,925 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:09,925 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:09,927 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-26 15:54:09,927 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:09,927 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:09,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:09,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:09,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:09,927 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-26 15:54:09,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:09,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:09,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:09,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:09,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:09,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:09,929 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:54:09,929 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-26 15:54:09,929 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:09,929 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:09,929 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,929 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:09,931 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,931 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,931 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:09,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:09,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:09,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:09,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:09,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:09,931 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:09,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:09,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:09,933 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:09,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:09,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:09,935 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:09,935 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,935 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,935 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:09,935 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,935 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,935 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:09,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:09,935 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:09,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:09,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:09,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:09,935 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:09,935 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:09,935 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:09,936 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:09,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:09,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:10,036 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:10,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:10,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:10,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:10,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,043 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:10,043 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:10,043 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-26 15:54:10,043 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-26 15:54:10,044 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,044 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,046 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:10,046 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:10,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:10,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:10,046 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:10,046 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:10,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,047 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:10,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,047 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,048 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-26 15:54:10,048 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,048 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-26 15:54:10,048 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:10,048 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-26 15:54:10,051 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:10,051 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:10,051 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:10,051 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. started... 2023-11-26 15:54:10,051 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4cfb0cd6c51e1e07ae54d6cd68e75931 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:10,465 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051f3e71b202ff48258767a041d0df47e6 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512051f3e71b202ff48258767a041d0df47e6 2023-11-26 15:54:10,871 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/2dd6a3c7e4f94dce8433bc0f0ba02f74 2023-11-26 15:54:10,876 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/2dd6a3c7e4f94dce8433bc0f0ba02f74 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/2dd6a3c7e4f94dce8433bc0f0ba02f74 2023-11-26 15:54:10,881 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/2dd6a3c7e4f94dce8433bc0f0ba02f74, entries=1, sequenceid=17, filesize=4.9 K 2023-11-26 15:54:10,882 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4cfb0cd6c51e1e07ae54d6cd68e75931 in 831ms, sequenceid=17, compaction requested=true 2023-11-26 15:54:10,882 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4cfb0cd6c51e1e07ae54d6cd68e75931: 2023-11-26 15:54:10,882 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:10,882 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:10,882 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:10,882 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:10,882 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-26 15:54:10,882 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-26 15:54:10,884 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:10,884 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:10,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:10,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:10,884 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,884 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:10,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:10,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:10,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:10,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:10,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-26 15:54:10,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3865a9e7[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:10,886 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-26 15:54:10,886 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,887 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,887 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-26 15:54:10,887 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-26 15:54:10,887 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:10,887 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:10,887 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:10,889 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-26 15:54:10,889 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:10,889 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:10,889 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-26 15:54:10,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:10,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:10,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:10,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:10,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:10,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:10,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:10,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:10,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:10,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:54:10,891 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-26 15:54:10,891 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:10,891 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:10,891 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,891 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:10,894 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,894 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:10,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:10,894 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:10,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:10,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:10,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:10,895 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:10,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:10,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:10,897 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:10,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:10,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:10,899 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:10,899 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:10,899 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:10,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:10,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:10,899 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:10,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:10,899 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,899 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:10,900 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:10,900 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,900 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:10,900 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,900 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:10,900 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:10,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:10,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:11,000 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:11,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:11,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:11,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:11,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,006 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:11,006 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:11,006 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-26 15:54:11,006 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-26 15:54:11,007 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,007 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,008 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:11,008 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:11,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:11,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:11,008 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:11,008 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:11,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,009 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:11,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,009 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,010 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-26 15:54:11,010 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,010 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-26 15:54:11,010 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:11,010 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-26 15:54:11,010 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:11,010 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:11,010 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:11,010 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. started... 2023-11-26 15:54:11,010 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4cfb0cd6c51e1e07ae54d6cd68e75931 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:11,427 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228b1149f89d67743e6bd51f17b5b818500 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228b1149f89d67743e6bd51f17b5b818500 2023-11-26 15:54:11,833 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/5cb867740c61443ab7e1cc99cbbc4ed1 2023-11-26 15:54:11,839 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/5cb867740c61443ab7e1cc99cbbc4ed1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/5cb867740c61443ab7e1cc99cbbc4ed1 2023-11-26 15:54:11,843 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/5cb867740c61443ab7e1cc99cbbc4ed1, entries=1, sequenceid=21, filesize=4.9 K 2023-11-26 15:54:11,844 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4cfb0cd6c51e1e07ae54d6cd68e75931 in 834ms, sequenceid=21, compaction requested=true 2023-11-26 15:54:11,844 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4cfb0cd6c51e1e07ae54d6cd68e75931: 2023-11-26 15:54:11,844 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:11,844 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:11,844 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:11,844 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:11,844 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-26 15:54:11,844 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-26 15:54:11,846 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:11,846 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:11,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:11,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:11,846 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:11,846 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:11,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:11,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:11,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:11,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-26 15:54:11,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@224df9d7[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:11,847 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-26 15:54:11,847 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,850 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,850 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-26 15:54:11,850 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-26 15:54:11,850 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:11,850 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:11,850 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:11,851 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:11,851 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-26 15:54:11,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:11,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:11,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:11,852 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:11,852 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-26 15:54:11,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:11,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:11,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:11,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:11,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:11,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:11,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:54:11,854 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-26 15:54:11,854 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:11,854 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:11,854 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,854 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:11,858 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,858 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:11,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:11,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,858 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:11,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:11,859 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:11,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:11,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:11,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:11,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:11,860 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:11,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:11,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:11,863 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:11,863 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,863 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:11,863 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,863 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:11,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:11,863 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:11,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:11,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:11,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:11,863 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:11,863 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,863 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,863 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,863 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:11,863 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:11,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:11,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:11,964 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:11,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:11,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:11,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:11,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,970 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:11,971 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:11,971 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-26 15:54:11,971 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-26 15:54:11,971 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,971 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,972 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:11,972 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:11,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:11,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:11,973 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:11,973 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:11,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:11,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,974 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,974 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-26 15:54:11,974 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:11,974 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-26 15:54:11,974 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:11,974 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-26 15:54:11,974 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:11,974 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:11,974 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:11,974 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. started... 2023-11-26 15:54:11,974 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4cfb0cd6c51e1e07ae54d6cd68e75931 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:12,387 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ecda53882aca42f785be26cad8b39937 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231ecda53882aca42f785be26cad8b39937 2023-11-26 15:54:12,793 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/8a97d9d1464c4f3c831e2a9e3b6b85ef 2023-11-26 15:54:12,798 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/8a97d9d1464c4f3c831e2a9e3b6b85ef as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/8a97d9d1464c4f3c831e2a9e3b6b85ef 2023-11-26 15:54:12,802 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/8a97d9d1464c4f3c831e2a9e3b6b85ef, entries=1, sequenceid=25, filesize=4.9 K 2023-11-26 15:54:12,803 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4cfb0cd6c51e1e07ae54d6cd68e75931 in 829ms, sequenceid=25, compaction requested=true 2023-11-26 15:54:12,803 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4cfb0cd6c51e1e07ae54d6cd68e75931: 2023-11-26 15:54:12,803 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:12,803 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:12,803 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:12,803 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:12,803 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-26 15:54:12,803 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-26 15:54:12,806 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:12,806 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:12,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:12,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:12,806 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,806 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:12,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:12,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:12,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:12,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:12,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-26 15:54:12,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6badf278[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:12,808 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-26 15:54:12,808 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,809 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,809 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-26 15:54:12,809 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-26 15:54:12,809 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:12,809 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:12,810 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:12,811 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-26 15:54:12,811 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:12,811 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:12,811 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-26 15:54:12,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:12,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:12,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:12,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:12,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:12,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:12,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:12,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:12,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:12,814 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:54:12,814 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-26 15:54:12,814 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:12,814 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:12,814 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,814 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:12,816 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,816 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:12,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,816 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:12,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:12,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:12,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:12,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:12,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,816 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:12,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:12,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,818 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:12,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:12,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:12,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:12,821 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:12,821 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,821 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,821 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:12,821 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,821 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,821 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:12,821 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:12,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-26 15:54:12,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:12,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:12,821 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,821 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:12,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:12,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:12,822 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:12,822 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:12,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:12,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:12,922 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:12,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:12,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:12,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:12,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,928 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:12,928 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:12,928 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-26 15:54:12,928 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-26 15:54:12,929 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,929 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,930 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:12,930 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:12,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:12,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:12,931 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:12,931 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:12,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:12,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,932 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,932 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-26 15:54:12,932 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:12,932 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-26 15:54:12,932 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:12,932 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-26 15:54:12,932 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:12,932 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:12,932 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:12,932 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. started... 2023-11-26 15:54:12,932 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4cfb0cd6c51e1e07ae54d6cd68e75931 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:13,346 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601013e44a73aab38488587ad1012065774d6 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601013e44a73aab38488587ad1012065774d6 2023-11-26 15:54:13,752 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/074b7837c0864a5fab1726c3a28bd965 2023-11-26 15:54:13,758 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/074b7837c0864a5fab1726c3a28bd965 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/074b7837c0864a5fab1726c3a28bd965 2023-11-26 15:54:13,762 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/074b7837c0864a5fab1726c3a28bd965, entries=1, sequenceid=29, filesize=4.9 K 2023-11-26 15:54:13,763 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4cfb0cd6c51e1e07ae54d6cd68e75931 in 831ms, sequenceid=29, compaction requested=true 2023-11-26 15:54:13,763 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4cfb0cd6c51e1e07ae54d6cd68e75931: 2023-11-26 15:54:13,763 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:13,763 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:13,763 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:13,763 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:13,763 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-26 15:54:13,763 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-26 15:54:13,765 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,765 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:13,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:13,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:13,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:13,765 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,765 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:13,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:13,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:13,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:13,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:13,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-26 15:54:13,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@468bf6c1[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:13,767 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-26 15:54:13,767 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,768 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,769 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-26 15:54:13,769 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-26 15:54:13,769 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:13,769 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:13,769 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:13,771 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:13,771 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-26 15:54:13,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:13,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:13,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:13,772 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:13,772 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-26 15:54:13,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:13,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:13,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:13,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:13,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:13,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:13,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:54:13,774 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-26 15:54:13,774 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:13,774 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:13,774 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,774 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:13,776 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,776 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:13,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:13,776 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:13,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:13,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:13,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:13,779 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:13,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:13,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:13,781 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:13,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:13,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:13,783 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:13,783 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,783 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:13,783 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:13,783 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:13,783 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:13,783 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:13,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:13,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:13,784 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:13,784 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,784 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,784 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:13,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:13,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:13,784 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:13,884 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:13,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:13,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:13,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:13,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,891 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:13,891 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:13,891 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-26 15:54:13,891 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-26 15:54:13,892 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,892 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,893 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:13,893 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:13,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:13,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:13,894 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:13,894 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:13,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:13,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,894 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,895 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-26 15:54:13,895 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:13,895 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-26 15:54:13,895 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:13,895 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-26 15:54:13,895 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:13,895 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:13,895 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:13,895 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. started... 2023-11-26 15:54:13,895 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4cfb0cd6c51e1e07ae54d6cd68e75931 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:14,309 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103277966f32b004c308f9275b4785e13ef to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103277966f32b004c308f9275b4785e13ef 2023-11-26 15:54:14,714 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/a23ffa1a50a0445aaaf493fc3885c72b 2023-11-26 15:54:14,720 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/a23ffa1a50a0445aaaf493fc3885c72b as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/a23ffa1a50a0445aaaf493fc3885c72b 2023-11-26 15:54:14,724 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/a23ffa1a50a0445aaaf493fc3885c72b, entries=1, sequenceid=33, filesize=4.9 K 2023-11-26 15:54:14,725 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4cfb0cd6c51e1e07ae54d6cd68e75931 in 830ms, sequenceid=33, compaction requested=true 2023-11-26 15:54:14,725 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4cfb0cd6c51e1e07ae54d6cd68e75931: 2023-11-26 15:54:14,726 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:14,726 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:14,726 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:14,726 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:14,726 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-26 15:54:14,726 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-26 15:54:14,728 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:14,728 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:14,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:14,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:14,729 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,729 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:14,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:14,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:14,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:14,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:14,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-26 15:54:14,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53345566[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:14,730 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-26 15:54:14,730 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,734 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,734 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-26 15:54:14,734 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-26 15:54:14,734 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:14,734 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:14,734 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:14,735 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-26 15:54:14,735 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:14,735 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:14,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:14,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:14,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:14,735 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-26 15:54:14,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:14,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:14,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:14,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:14,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:14,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:14,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:54:14,738 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-26 15:54:14,738 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:14,738 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:14,738 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,738 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:14,740 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,740 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:14,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:14,740 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:14,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:14,740 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:14,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:14,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:14,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:14,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:14,742 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:14,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:14,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:14,745 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:14,745 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:14,745 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:14,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:14,745 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:14,745 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,745 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:14,745 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-26 15:54:14,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:14,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:14,745 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:14,745 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:14,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:14,746 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,746 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:14,746 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,746 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:14,846 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:14,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:14,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:14,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:14,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,853 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:14,853 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:14,853 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-26 15:54:14,853 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-26 15:54:14,853 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,853 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,855 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:14,855 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:14,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:14,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:14,855 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:14,855 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:14,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,856 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:14,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,856 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,856 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-26 15:54:14,856 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:14,857 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-26 15:54:14,857 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:14,857 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-26 15:54:14,857 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:14,857 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:14,857 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:14,857 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. started... 2023-11-26 15:54:14,857 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4cfb0cd6c51e1e07ae54d6cd68e75931 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:15,270 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090783e2e8e1f19f48099217f2ba7efb580b to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015090783e2e8e1f19f48099217f2ba7efb580b 2023-11-26 15:54:15,275 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/56403a8aaddf42edae29e660c8ee2e7e 2023-11-26 15:54:15,280 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/56403a8aaddf42edae29e660c8ee2e7e as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/56403a8aaddf42edae29e660c8ee2e7e 2023-11-26 15:54:15,285 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/56403a8aaddf42edae29e660c8ee2e7e, entries=1, sequenceid=37, filesize=4.9 K 2023-11-26 15:54:15,286 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4cfb0cd6c51e1e07ae54d6cd68e75931 in 429ms, sequenceid=37, compaction requested=true 2023-11-26 15:54:15,286 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4cfb0cd6c51e1e07ae54d6cd68e75931: 2023-11-26 15:54:15,286 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:15,286 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:15,286 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:15,286 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,286 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-26 15:54:15,286 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-26 15:54:15,288 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,288 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:15,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:15,289 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,289 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:15,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:15,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:15,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:15,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-26 15:54:15,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1efa9d96[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:15,291 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-26 15:54:15,291 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,292 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,292 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-26 15:54:15,292 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-26 15:54:15,292 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:15,293 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,293 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:15,295 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-26 15:54:15,295 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,295 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:15,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:15,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:15,295 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-26 15:54:15,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:15,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:15,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:15,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:15,298 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:54:15,298 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-26 15:54:15,298 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:15,298 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:15,299 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,299 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:15,300 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,300 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:15,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:15,300 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:15,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:15,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:15,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:15,301 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:15,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,302 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:15,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,305 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,305 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,305 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:15,305 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:15,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:15,305 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:15,305 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:15,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:15,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:15,305 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,305 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,305 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,305 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:15,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:15,306 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:15,306 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:15,406 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:15,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:15,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:15,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:15,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,413 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:15,413 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:15,413 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-26 15:54:15,413 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-26 15:54:15,414 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,414 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,415 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,415 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:15,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:15,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:15,415 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,415 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:15,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:15,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,416 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,417 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-26 15:54:15,417 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,417 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-26 15:54:15,417 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:15,417 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-26 15:54:15,417 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:15,417 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:15,417 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:15,417 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. started... 2023-11-26 15:54:15,417 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4cfb0cd6c51e1e07ae54d6cd68e75931 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:15,831 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112009ed93fff4334031abdc55214edec8cc to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015112009ed93fff4334031abdc55214edec8cc 2023-11-26 15:54:15,837 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/8d23c7b34e5f4ff4985aac433aff7cca 2023-11-26 15:54:15,842 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/8d23c7b34e5f4ff4985aac433aff7cca as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/8d23c7b34e5f4ff4985aac433aff7cca 2023-11-26 15:54:15,847 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/8d23c7b34e5f4ff4985aac433aff7cca, entries=1, sequenceid=41, filesize=4.9 K 2023-11-26 15:54:15,848 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4cfb0cd6c51e1e07ae54d6cd68e75931 in 431ms, sequenceid=41, compaction requested=true 2023-11-26 15:54:15,848 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4cfb0cd6c51e1e07ae54d6cd68e75931: 2023-11-26 15:54:15,848 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:15,848 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:15,849 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:15,849 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,849 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-26 15:54:15,849 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-26 15:54:15,851 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,851 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:15,852 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,852 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:15,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:15,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:15,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:15,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-26 15:54:15,853 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-26 15:54:15,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a409203[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:15,853 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,854 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,855 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-26 15:54:15,855 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-26 15:54:15,855 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:15,855 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,855 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:15,856 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-26 15:54:15,856 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,856 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:15,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:15,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:15,856 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-26 15:54:15,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:15,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:15,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:15,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:15,859 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:54:15,859 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-26 15:54:15,859 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:15,859 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:15,859 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,859 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:15,861 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,861 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:15,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,861 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:15,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:15,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:15,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:15,862 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:15,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,863 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:15,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,867 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,867 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,867 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:15,867 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:15,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-26 15:54:15,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:15,867 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:15,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:15,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-26 15:54:15,867 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:15,867 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:15,867 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:15,867 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,867 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:15,867 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:15,867 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:15,967 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:15,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:15,970 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33415] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-11-26 15:54:15,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-26 15:54:15,972 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-26 15:54:15,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:54:15,973 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701014655973 2023-11-26 15:54:15,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-26 15:54:15,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-26 15:54:15,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-26 15:54:15,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] zookeeper.ReadOnlyZKClient(139): Connect 0x319bf77e to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:54:15,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ae347ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:54:15,987 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-26 15:54:16,426 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031b74e86154d347ff8218503387b0b42a to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601031b74e86154d347ff8218503387b0b42a 2023-11-26 15:54:16,427 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-26 15:54:16,440 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:54:16,441 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55020, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:54:16,448 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-26 15:54:16,449 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-26 15:54:16,457 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e06d2c92415245d098d432c867d49762 first=Optional[r3] last=Optional[r6] 2023-11-26 15:54:16,458 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e06d2c92415245d098d432c867d49762}] 2023-11-26 15:54:16,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e06d2c92415245d098d432c867d49762 for inclusion in 4cfb0cd6c51e1e07ae54d6cd68e75931/family1 2023-11-26 15:54:16,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-26 15:54:16,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last= 2023-11-26 15:54:16,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for 4cfb0cd6c51e1e07ae54d6cd68e75931: 2023-11-26 15:54:16,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e06d2c92415245d098d432c867d49762 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__tktnap6qneo2a3nk8vmtdl5m1eipe1e2hse2vh8hd4uf2r58b9q0cdsq5k1gvoep/family1/e06d2c92415245d098d432c867d49762 2023-11-26 15:54:16,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__tktnap6qneo2a3nk8vmtdl5m1eipe1e2hse2vh8hd4uf2r58b9q0cdsq5k1gvoep/family1/e06d2c92415245d098d432c867d49762 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/e40b30e7d2c140639e3e2f80aacaa27b_SeqId_44_ 2023-11-26 15:54:16,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__tktnap6qneo2a3nk8vmtdl5m1eipe1e2hse2vh8hd4uf2r58b9q0cdsq5k1gvoep/family1/e06d2c92415245d098d432c867d49762 into 4cfb0cd6c51e1e07ae54d6cd68e75931/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/e40b30e7d2c140639e3e2f80aacaa27b_SeqId_44_ - updating store file list. 2023-11-26 15:54:16,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/e40b30e7d2c140639e3e2f80aacaa27b_SeqId_44_ into 4cfb0cd6c51e1e07ae54d6cd68e75931/family1 2023-11-26 15:54:16,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__tktnap6qneo2a3nk8vmtdl5m1eipe1e2hse2vh8hd4uf2r58b9q0cdsq5k1gvoep/family1/e06d2c92415245d098d432c867d49762 into 4cfb0cd6c51e1e07ae54d6cd68e75931/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/e40b30e7d2c140639e3e2f80aacaa27b_SeqId_44_) 2023-11-26 15:54:16,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__tktnap6qneo2a3nk8vmtdl5m1eipe1e2hse2vh8hd4uf2r58b9q0cdsq5k1gvoep/family1/e06d2c92415245d098d432c867d49762 2023-11-26 15:54:16,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-26 15:54:16,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-26 15:54:16,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(1912): 4cfb0cd6c51e1e07ae54d6cd68e75931/family1 is initiating minor compaction 2023-11-26 15:54:16,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6a2ee275; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:54:16,475 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4cfb0cd6c51e1e07ae54d6cd68e75931/family1 in testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:16,476 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/de47d9942b2943f5b0fc5bcddaba2c82, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/72a13ddd6dfa42fbb995470fbf7004cf, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/2dd6a3c7e4f94dce8433bc0f0ba02f74, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/5cb867740c61443ab7e1cc99cbbc4ed1, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/8a97d9d1464c4f3c831e2a9e3b6b85ef, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/074b7837c0864a5fab1726c3a28bd965, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/a23ffa1a50a0445aaaf493fc3885c72b, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/56403a8aaddf42edae29e660c8ee2e7e, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/8d23c7b34e5f4ff4985aac433aff7cca, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/e40b30e7d2c140639e3e2f80aacaa27b_SeqId_44_] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp, totalSize=50.0 K 2023-11-26 15:54:16,476 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting de47d9942b2943f5b0fc5bcddaba2c82, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-26 15:54:16,476 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 72a13ddd6dfa42fbb995470fbf7004cf, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-26 15:54:16,476 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 2dd6a3c7e4f94dce8433bc0f0ba02f74, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-26 15:54:16,476 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 5cb867740c61443ab7e1cc99cbbc4ed1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-26 15:54:16,476 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 8a97d9d1464c4f3c831e2a9e3b6b85ef, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-26 15:54:16,476 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 074b7837c0864a5fab1726c3a28bd965, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-26 15:54:16,476 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting a23ffa1a50a0445aaaf493fc3885c72b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-26 15:54:16,476 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 56403a8aaddf42edae29e660c8ee2e7e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-26 15:54:16,476 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 8d23c7b34e5f4ff4985aac433aff7cca, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-26 15:54:16,476 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting e40b30e7d2c140639e3e2f80aacaa27b_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-26 15:54:16,477 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-26 15:54:16,478 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:16,480 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228b1149f89d67743e6bd51f17b5b818500 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228b1149f89d67743e6bd51f17b5b818500 2023-11-26 15:54:16,481 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231ecda53882aca42f785be26cad8b39937 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231ecda53882aca42f785be26cad8b39937 2023-11-26 15:54:16,483 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601013e44a73aab38488587ad1012065774d6 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601013e44a73aab38488587ad1012065774d6 2023-11-26 15:54:16,485 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103277966f32b004c308f9275b4785e13ef to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103277966f32b004c308f9275b4785e13ef 2023-11-26 15:54:16,485 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-26 15:54:16,485 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-26 15:54:16,485 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-26 15:54:16,485 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-26 15:54:16,485 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-26 15:54:16,485 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-26 15:54:16,485 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-26 15:54:16,485 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-26 15:54:16,485 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-26 15:54:16,485 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-26 15:54:16,522 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4cfb0cd6c51e1e07ae54d6cd68e75931#family1#compaction#49 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:54:17,340 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/21cb1e5454984658bfb4f3cd84bf2a54 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/21cb1e5454984658bfb4f3cd84bf2a54 2023-11-26 15:54:17,345 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 4cfb0cd6c51e1e07ae54d6cd68e75931/family1 of 4cfb0cd6c51e1e07ae54d6cd68e75931 into 21cb1e5454984658bfb4f3cd84bf2a54(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:54:17,345 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4cfb0cd6c51e1e07ae54d6cd68e75931: 2023-11-26 15:54:17,345 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1701014056475; duration=0sec 2023-11-26 15:54:17,346 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:54:17,355 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205830c74273a12492d814c25b0e6f45c97 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205830c74273a12492d814c25b0e6f45c97 2023-11-26 15:54:17,356 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-26 15:54:17,385 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ec085787ef89488282a599802c8b8636 first=Optional[r00] last=Optional[r2] 2023-11-26 15:54:17,385 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ec085787ef89488282a599802c8b8636}] 2023-11-26 15:54:17,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ec085787ef89488282a599802c8b8636 for inclusion in 4cfb0cd6c51e1e07ae54d6cd68e75931/family1 2023-11-26 15:54:17,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-26 15:54:17,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last= 2023-11-26 15:54:17,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for 4cfb0cd6c51e1e07ae54d6cd68e75931: 2023-11-26 15:54:17,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/ec085787ef89488282a599802c8b8636 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__puu58dob41alnt4oef2j2ric9vtkgfdqgn9t5qalmuq68vc8ck36qn6noleafknu/family1/ec085787ef89488282a599802c8b8636 2023-11-26 15:54:17,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__puu58dob41alnt4oef2j2ric9vtkgfdqgn9t5qalmuq68vc8ck36qn6noleafknu/family1/ec085787ef89488282a599802c8b8636 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/2285f4e0712d43fa8f04892afcfc3c57_SeqId_47_ 2023-11-26 15:54:17,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__puu58dob41alnt4oef2j2ric9vtkgfdqgn9t5qalmuq68vc8ck36qn6noleafknu/family1/ec085787ef89488282a599802c8b8636 into 4cfb0cd6c51e1e07ae54d6cd68e75931/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/2285f4e0712d43fa8f04892afcfc3c57_SeqId_47_ - updating store file list. 2023-11-26 15:54:17,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/2285f4e0712d43fa8f04892afcfc3c57_SeqId_47_ into 4cfb0cd6c51e1e07ae54d6cd68e75931/family1 2023-11-26 15:54:17,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__puu58dob41alnt4oef2j2ric9vtkgfdqgn9t5qalmuq68vc8ck36qn6noleafknu/family1/ec085787ef89488282a599802c8b8636 into 4cfb0cd6c51e1e07ae54d6cd68e75931/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/2285f4e0712d43fa8f04892afcfc3c57_SeqId_47_) 2023-11-26 15:54:17,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyPolicy__puu58dob41alnt4oef2j2ric9vtkgfdqgn9t5qalmuq68vc8ck36qn6noleafknu/family1/ec085787ef89488282a599802c8b8636 2023-11-26 15:54:17,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-26 15:54:17,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-26 15:54:17,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(1912): 4cfb0cd6c51e1e07ae54d6cd68e75931/family1 is initiating minor compaction (all files) 2023-11-26 15:54:17,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7ab3f746; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:54:17,399 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4cfb0cd6c51e1e07ae54d6cd68e75931/family1 in testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:54:17,399 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/c4b54b1d0f184a6994ffbaff088a0782, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/21cb1e5454984658bfb4f3cd84bf2a54, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/2285f4e0712d43fa8f04892afcfc3c57_SeqId_47_] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp, totalSize=337.0 K 2023-11-26 15:54:17,400 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting c4b54b1d0f184a6994ffbaff088a0782, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823935 2023-11-26 15:54:17,400 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 21cb1e5454984658bfb4f3cd84bf2a54, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223935 2023-11-26 15:54:17,401 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 2285f4e0712d43fa8f04892afcfc3c57_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878823935 2023-11-26 15:54:17,401 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-26 15:54:17,402 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:17,403 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130f764dd92986a4cf7ab66d4123687c005 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130f764dd92986a4cf7ab66d4123687c005 2023-11-26 15:54:17,405 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512016d4a9b773ccb4ed6b21eed50d7a546f7 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512016d4a9b773ccb4ed6b21eed50d7a546f7 2023-11-26 15:54:17,406 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512051f3e71b202ff48258767a041d0df47e6 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512051f3e71b202ff48258767a041d0df47e6 2023-11-26 15:54:17,406 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-11-26 15:54:17,406 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-26 15:54:17,407 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-26 15:54:17,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-26 15:54:17,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:54:17,408 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-26 15:54:17,410 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4380 sec 2023-11-26 15:54:17,429 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/de47d9942b2943f5b0fc5bcddaba2c82, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/72a13ddd6dfa42fbb995470fbf7004cf, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/2dd6a3c7e4f94dce8433bc0f0ba02f74, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/5cb867740c61443ab7e1cc99cbbc4ed1, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/8a97d9d1464c4f3c831e2a9e3b6b85ef, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/074b7837c0864a5fab1726c3a28bd965, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/a23ffa1a50a0445aaaf493fc3885c72b, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/56403a8aaddf42edae29e660c8ee2e7e, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/8d23c7b34e5f4ff4985aac433aff7cca, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/e40b30e7d2c140639e3e2f80aacaa27b_SeqId_44_] to archive 2023-11-26 15:54:17,430 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4cfb0cd6c51e1e07ae54d6cd68e75931#family1#compaction#50 average throughput is 7.73 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:54:17,430 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:17,450 WARN [IPC Server handler 1 on default port 41123] namenode.FSDirRenameOp(189): DIR* FSDirectory.unprotectedRenameTo: failed to rename /user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/de47d9942b2943f5b0fc5bcddaba2c82 to /user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/de47d9942b2943f5b0fc5bcddaba2c82 because destination's parent does not exist 2023-11-26 15:54:17,451 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(557): Created archive directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1 2023-11-26 15:54:17,453 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/de47d9942b2943f5b0fc5bcddaba2c82 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/de47d9942b2943f5b0fc5bcddaba2c82 2023-11-26 15:54:17,454 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/72a13ddd6dfa42fbb995470fbf7004cf to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/72a13ddd6dfa42fbb995470fbf7004cf 2023-11-26 15:54:17,456 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/2dd6a3c7e4f94dce8433bc0f0ba02f74 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/2dd6a3c7e4f94dce8433bc0f0ba02f74 2023-11-26 15:54:17,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/5cb867740c61443ab7e1cc99cbbc4ed1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/5cb867740c61443ab7e1cc99cbbc4ed1 2023-11-26 15:54:17,462 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/8a97d9d1464c4f3c831e2a9e3b6b85ef to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/8a97d9d1464c4f3c831e2a9e3b6b85ef 2023-11-26 15:54:17,463 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/074b7837c0864a5fab1726c3a28bd965 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/074b7837c0864a5fab1726c3a28bd965 2023-11-26 15:54:17,465 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/a23ffa1a50a0445aaaf493fc3885c72b to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/a23ffa1a50a0445aaaf493fc3885c72b 2023-11-26 15:54:17,472 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/56403a8aaddf42edae29e660c8ee2e7e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/56403a8aaddf42edae29e660c8ee2e7e 2023-11-26 15:54:17,477 DEBUG [hfile_cleaner-dir-scan-pool-0] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750) at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:455) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 35 more 2023-11-26 15:54:17,478 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/8d23c7b34e5f4ff4985aac433aff7cca to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/8d23c7b34e5f4ff4985aac433aff7cca 2023-11-26 15:54:17,481 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/e40b30e7d2c140639e3e2f80aacaa27b_SeqId_44_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/e40b30e7d2c140639e3e2f80aacaa27b_SeqId_44_ 2023-11-26 15:54:17,550 INFO [Listener at localhost/43645] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=268 (was 255) - Thread LEAK? -, OpenFileDescriptor=660 (was 631) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=220 (was 254), ProcessCount=171 (was 171), AvailableMemoryMB=8415 (was 8422) 2023-11-26 15:54:17,564 INFO [Listener at localhost/43645] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=268, OpenFileDescriptor=660, MaxFileDescriptor=60000, SystemLoadAverage=220, ProcessCount=171, AvailableMemoryMB=8415 2023-11-26 15:54:17,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-26 15:54:17,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:17,568 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-26 15:54:17,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-11-26 15:54:17,569 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-26 15:54:17,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-26 15:54:17,570 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:17,570 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a empty. 2023-11-26 15:54:17,571 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:17,571 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-11-26 15:54:17,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-26 15:54:17,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-26 15:54:17,983 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-26 15:54:17,985 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 905abcb77b8ecc225b5ac5b6464c5c8a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:54:18,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-26 15:54:18,303 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/.tmp/family1/1740a59226114b25b0bea84bacbb8ad6 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/1740a59226114b25b0bea84bacbb8ad6 2023-11-26 15:54:18,308 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 4cfb0cd6c51e1e07ae54d6cd68e75931/family1 of 4cfb0cd6c51e1e07ae54d6cd68e75931 into 1740a59226114b25b0bea84bacbb8ad6(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:54:18,308 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4cfb0cd6c51e1e07ae54d6cd68e75931: 2023-11-26 15:54:18,309 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1701014057399; duration=0sec 2023-11-26 15:54:18,309 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:54:18,325 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/c4b54b1d0f184a6994ffbaff088a0782, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/21cb1e5454984658bfb4f3cd84bf2a54, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/2285f4e0712d43fa8f04892afcfc3c57_SeqId_47_] to archive 2023-11-26 15:54:18,325 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:18,327 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/c4b54b1d0f184a6994ffbaff088a0782 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/c4b54b1d0f184a6994ffbaff088a0782 2023-11-26 15:54:18,329 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/21cb1e5454984658bfb4f3cd84bf2a54 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/21cb1e5454984658bfb4f3cd84bf2a54 2023-11-26 15:54:18,330 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/2285f4e0712d43fa8f04892afcfc3c57_SeqId_47_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/family1/2285f4e0712d43fa8f04892afcfc3c57_SeqId_47_ 2023-11-26 15:54:18,391 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:18,391 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 905abcb77b8ecc225b5ac5b6464c5c8a, disabling compactions & flushes 2023-11-26 15:54:18,391 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:18,391 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:18,391 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. after waiting 0 ms 2023-11-26 15:54:18,391 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:18,391 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:18,391 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:18,394 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-11-26 15:54:18,395 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701014058394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014058394"}]},"ts":"1701014058394"} 2023-11-26 15:54:18,396 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-26 15:54:18,397 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-26 15:54:18,397 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014058397"}]},"ts":"1701014058397"} 2023-11-26 15:54:18,398 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-11-26 15:54:18,402 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=905abcb77b8ecc225b5ac5b6464c5c8a, ASSIGN}] 2023-11-26 15:54:18,403 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=905abcb77b8ecc225b5ac5b6464c5c8a, ASSIGN 2023-11-26 15:54:18,404 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=905abcb77b8ecc225b5ac5b6464c5c8a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:54:18,555 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=905abcb77b8ecc225b5ac5b6464c5c8a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:18,555 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701014058555"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014058555"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014058555"}]},"ts":"1701014058555"} 2023-11-26 15:54:18,557 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 905abcb77b8ecc225b5ac5b6464c5c8a, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:54:18,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-26 15:54:18,709 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:18,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:18,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 905abcb77b8ecc225b5ac5b6464c5c8a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.', STARTKEY => '', ENDKEY => ''} 2023-11-26 15:54:18,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:18,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:18,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:18,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:18,714 INFO [StoreOpener-905abcb77b8ecc225b5ac5b6464c5c8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:18,716 DEBUG [StoreOpener-905abcb77b8ecc225b5ac5b6464c5c8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1 2023-11-26 15:54:18,716 DEBUG [StoreOpener-905abcb77b8ecc225b5ac5b6464c5c8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1 2023-11-26 15:54:18,716 INFO [StoreOpener-905abcb77b8ecc225b5ac5b6464c5c8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 905abcb77b8ecc225b5ac5b6464c5c8a columnFamilyName family1 2023-11-26 15:54:18,718 INFO [StoreOpener-905abcb77b8ecc225b5ac5b6464c5c8a-1] regionserver.HStore(310): Store=905abcb77b8ecc225b5ac5b6464c5c8a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:54:18,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:18,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:18,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:18,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:54:18,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 905abcb77b8ecc225b5ac5b6464c5c8a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64425564, jitterRate=-0.039984285831451416}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-26 15:54:18,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:18,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a., pid=41, masterSystemTime=1701014058709 2023-11-26 15:54:18,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:18,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:18,726 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=905abcb77b8ecc225b5ac5b6464c5c8a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:18,727 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701014058726"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014058726"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014058726"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014058726"}]},"ts":"1701014058726"} 2023-11-26 15:54:18,730 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=41, resume processing ppid=40 2023-11-26 15:54:18,730 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 905abcb77b8ecc225b5ac5b6464c5c8a, server=jenkins-hbase4.apache.org,41861,1701014000937 in 171 msec 2023-11-26 15:54:18,732 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=40, resume processing ppid=39 2023-11-26 15:54:18,732 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=905abcb77b8ecc225b5ac5b6464c5c8a, ASSIGN in 328 msec 2023-11-26 15:54:18,732 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-26 15:54:18,732 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014058732"}]},"ts":"1701014058732"} 2023-11-26 15:54:18,734 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-11-26 15:54:18,737 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-11-26 15:54:18,738 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1710 sec 2023-11-26 15:54:19,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-26 15:54:19,674 INFO [Listener at localhost/43645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-11-26 15:54:19,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:19,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:19,703 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:19,703 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:19,703 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-26 15:54:19,703 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-26 15:54:19,704 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:19,704 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:19,705 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:19,705 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:19,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:19,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:19,706 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:19,706 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:19,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:19,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:19,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:19,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:19,706 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:19,707 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:19,707 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-26 15:54:19,707 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:19,707 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-26 15:54:19,707 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:19,707 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:19,707 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:19,707 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. started... 2023-11-26 15:54:19,708 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 905abcb77b8ecc225b5ac5b6464c5c8a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-26 15:54:20,131 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e7a70f8a42f441ecbd425300b019d1aa to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130e7a70f8a42f441ecbd425300b019d1aa 2023-11-26 15:54:20,535 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/0ac931ab6f294a75bcf9af76be01da57 2023-11-26 15:54:20,541 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/0ac931ab6f294a75bcf9af76be01da57 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/0ac931ab6f294a75bcf9af76be01da57 2023-11-26 15:54:20,545 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/0ac931ab6f294a75bcf9af76be01da57, entries=1000, sequenceid=5, filesize=191.4 K 2023-11-26 15:54:20,546 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 905abcb77b8ecc225b5ac5b6464c5c8a in 838ms, sequenceid=5, compaction requested=false 2023-11-26 15:54:20,546 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:20,547 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:20,547 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:20,547 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:20,547 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:20,547 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:20,547 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-26 15:54:20,547 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-26 15:54:20,549 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:20,549 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:20,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:20,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:20,549 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,549 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:20,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:20,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:20,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:20,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:20,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-26 15:54:20,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e44274[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:20,550 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-26 15:54:20,551 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,552 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,552 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-26 15:54:20,552 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-26 15:54:20,552 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:20,552 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:20,552 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:20,553 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-26 15:54:20,553 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:20,553 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:20,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:20,553 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-26 15:54:20,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:20,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:20,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:20,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:20,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:20,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:20,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:20,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:20,556 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-26 15:54:20,556 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-26 15:54:20,556 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:20,556 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:20,556 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,556 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:20,558 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,558 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:20,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:20,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,558 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:20,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:20,559 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:20,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:20,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:20,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:20,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:20,560 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:20,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:20,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:20,563 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:20,563 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,563 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:20,563 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:20,563 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:20,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:20,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:20,563 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:20,563 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:20,563 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:20,563 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,563 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,563 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:20,563 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:20,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:20,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:20,663 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:20,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:20,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:20,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:20,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,670 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:20,670 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:20,670 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-26 15:54:20,670 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-26 15:54:20,671 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,671 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,672 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:20,672 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:20,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:20,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:20,673 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:20,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,673 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:20,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:20,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,673 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,674 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-26 15:54:20,674 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:20,674 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-26 15:54:20,674 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:20,674 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-26 15:54:20,674 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:20,674 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:20,674 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:20,674 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. started... 2023-11-26 15:54:20,674 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 905abcb77b8ecc225b5ac5b6464c5c8a 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-26 15:54:21,089 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128fe7cfaf8f6814622b0cc8a2e6415d626 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128fe7cfaf8f6814622b0cc8a2e6415d626 2023-11-26 15:54:21,495 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/bd13d4452dc14194812dc4af964ed248 2023-11-26 15:54:21,500 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/bd13d4452dc14194812dc4af964ed248 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/bd13d4452dc14194812dc4af964ed248 2023-11-26 15:54:21,505 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/bd13d4452dc14194812dc4af964ed248, entries=1, sequenceid=9, filesize=5.0 K 2023-11-26 15:54:21,506 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 905abcb77b8ecc225b5ac5b6464c5c8a in 832ms, sequenceid=9, compaction requested=false 2023-11-26 15:54:21,506 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:21,506 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:21,506 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:21,506 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:21,506 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:21,506 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-26 15:54:21,506 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-26 15:54:21,509 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:21,509 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:21,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:21,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:21,509 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,509 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:21,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:21,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:21,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:21,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:21,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-26 15:54:21,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@728ab80b[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:21,511 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-26 15:54:21,511 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,516 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,517 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-26 15:54:21,517 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-26 15:54:21,517 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:21,517 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:21,517 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:21,518 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-26 15:54:21,518 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:21,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:21,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:21,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:21,518 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:21,518 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-26 15:54:21,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:21,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:21,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:21,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:21,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:21,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:21,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-26 15:54:21,521 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-26 15:54:21,521 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:21,521 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:21,521 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,521 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:21,522 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,522 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:21,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:21,522 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:21,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:21,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:21,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:21,523 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:21,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:21,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:21,524 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:21,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:21,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:21,530 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:21,530 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:21,530 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:21,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:21,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:21,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:21,530 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,530 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:21,530 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:21,530 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:21,530 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,530 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,530 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:21,530 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:21,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:21,531 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:21,631 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:21,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:21,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:21,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:21,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,638 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:21,638 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:21,638 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-26 15:54:21,638 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-26 15:54:21,638 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,638 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,640 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:21,640 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:21,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:21,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:21,640 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:21,640 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:21,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:21,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,641 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,641 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-26 15:54:21,641 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:21,642 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-26 15:54:21,642 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:21,642 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-26 15:54:21,642 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:21,642 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:21,642 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:21,642 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. started... 2023-11-26 15:54:21,642 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 905abcb77b8ecc225b5ac5b6464c5c8a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:22,055 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512017d0ed83b9a35491d8bac9d4907524143 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512017d0ed83b9a35491d8bac9d4907524143 2023-11-26 15:54:22,460 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/850d778c06be4487b690a2806ac02d4e 2023-11-26 15:54:22,466 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/850d778c06be4487b690a2806ac02d4e as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/850d778c06be4487b690a2806ac02d4e 2023-11-26 15:54:22,470 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/850d778c06be4487b690a2806ac02d4e, entries=1, sequenceid=13, filesize=5.0 K 2023-11-26 15:54:22,471 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 905abcb77b8ecc225b5ac5b6464c5c8a in 829ms, sequenceid=13, compaction requested=true 2023-11-26 15:54:22,471 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:22,471 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:22,471 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:22,472 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:22,472 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:22,472 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-26 15:54:22,472 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-26 15:54:22,474 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:22,474 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:22,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:22,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:22,475 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,475 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:22,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:22,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:22,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:22,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:22,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-26 15:54:22,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38569de1[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:22,476 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-26 15:54:22,476 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,477 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,478 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-26 15:54:22,478 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-26 15:54:22,478 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:22,478 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:22,478 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:22,479 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-26 15:54:22,479 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:22,479 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:22,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:22,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:22,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:22,479 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-26 15:54:22,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:22,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:22,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:22,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:22,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:22,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:22,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-26 15:54:22,481 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-26 15:54:22,482 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:22,482 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:22,482 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,482 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:22,483 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,483 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:22,483 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:22,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:22,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:22,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:22,484 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:22,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:22,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:22,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:22,485 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:22,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:22,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:22,488 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:22,488 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:22,488 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,488 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:22,488 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:22,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:22,488 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:22,488 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:22,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:22,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:22,488 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,489 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:22,489 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:22,489 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,489 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:22,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:22,589 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:22,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:22,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:22,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:22,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,595 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:22,595 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:22,595 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-26 15:54:22,595 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-26 15:54:22,596 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,596 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,597 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:22,597 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:22,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:22,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:22,597 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:22,598 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:22,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,598 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:22,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,598 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,599 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-26 15:54:22,599 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:22,599 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-26 15:54:22,599 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:22,599 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-26 15:54:22,599 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:22,599 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:22,599 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:22,599 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. started... 2023-11-26 15:54:22,599 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 905abcb77b8ecc225b5ac5b6464c5c8a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:23,013 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a541d6abed744e0ea9028db066c0682f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205a541d6abed744e0ea9028db066c0682f 2023-11-26 15:54:23,419 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/09ad461be4fa4a4e9d3aa5247dc01b45 2023-11-26 15:54:23,424 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/09ad461be4fa4a4e9d3aa5247dc01b45 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/09ad461be4fa4a4e9d3aa5247dc01b45 2023-11-26 15:54:23,429 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/09ad461be4fa4a4e9d3aa5247dc01b45, entries=1, sequenceid=17, filesize=5.0 K 2023-11-26 15:54:23,429 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 905abcb77b8ecc225b5ac5b6464c5c8a in 830ms, sequenceid=17, compaction requested=true 2023-11-26 15:54:23,429 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:23,429 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:23,430 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:23,430 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:23,430 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:23,430 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-26 15:54:23,430 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-26 15:54:23,432 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:23,432 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:23,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:23,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:23,433 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,433 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:23,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:23,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:23,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:23,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:23,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-26 15:54:23,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2618c062[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:23,434 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-26 15:54:23,434 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,436 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,436 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-26 15:54:23,436 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-26 15:54:23,436 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:23,436 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:23,437 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:23,438 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-26 15:54:23,438 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:23,438 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:23,438 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-26 15:54:23,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:23,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:23,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:23,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:23,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:23,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:23,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:23,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:23,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:23,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-26 15:54:23,441 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-26 15:54:23,441 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:23,441 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:23,441 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,441 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:23,443 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,443 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,443 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:23,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:23,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:23,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:23,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:23,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:23,444 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:23,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:23,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,445 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:23,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:23,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:23,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:23,447 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:23,447 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,448 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:23,448 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:23,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:23,448 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:23,448 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:23,448 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:23,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-26 15:54:23,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:23,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:23,448 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,448 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,448 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:23,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:23,448 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:23,448 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:23,549 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:23,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:23,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:23,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:23,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,555 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:23,555 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:23,555 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-26 15:54:23,555 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-26 15:54:23,555 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,555 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,558 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:23,558 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:23,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:23,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:23,558 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:23,558 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:23,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:23,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,559 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,559 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-26 15:54:23,559 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:23,559 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-26 15:54:23,559 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:23,559 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-26 15:54:23,559 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:23,559 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:23,560 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:23,560 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. started... 2023-11-26 15:54:23,560 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 905abcb77b8ecc225b5ac5b6464c5c8a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:23,973 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512288e9dc3393a3a4f2c8cffb961d7bb66f4 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512288e9dc3393a3a4f2c8cffb961d7bb66f4 2023-11-26 15:54:24,252 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-26 15:54:24,379 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/26abcb567ea346709cd611db3a47640f 2023-11-26 15:54:24,384 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/26abcb567ea346709cd611db3a47640f as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/26abcb567ea346709cd611db3a47640f 2023-11-26 15:54:24,388 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/26abcb567ea346709cd611db3a47640f, entries=1, sequenceid=21, filesize=5.0 K 2023-11-26 15:54:24,389 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 905abcb77b8ecc225b5ac5b6464c5c8a in 829ms, sequenceid=21, compaction requested=true 2023-11-26 15:54:24,389 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:24,389 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:24,389 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:24,389 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:24,389 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,389 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-26 15:54:24,389 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-26 15:54:24,393 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,393 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:24,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:24,393 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,393 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:24,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:24,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:24,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:24,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-26 15:54:24,395 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-26 15:54:24,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cec137[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:24,395 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,396 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,396 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-26 15:54:24,397 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-26 15:54:24,397 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:24,397 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,397 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:24,398 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,398 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-26 15:54:24,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:24,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:24,398 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:24,398 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-26 15:54:24,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:24,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:24,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:24,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:24,401 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-26 15:54:24,401 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-26 15:54:24,401 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:24,401 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:24,401 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,401 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:24,404 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,404 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:24,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:24,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,404 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:24,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:24,405 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:24,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:24,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:24,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,406 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:24,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,409 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,409 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,409 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,409 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,409 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,409 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,409 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,409 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:24,409 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-26 15:54:24,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:24,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:24,409 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:24,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:24,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:24,409 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:24,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:24,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:24,410 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:24,410 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:24,510 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:24,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:24,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:24,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:24,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,517 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:24,517 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:24,517 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-26 15:54:24,517 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-26 15:54:24,518 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,518 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,519 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,519 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:24,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:24,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:24,519 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,520 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:24,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:24,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,520 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,521 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-26 15:54:24,521 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,521 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-26 15:54:24,521 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:24,521 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-26 15:54:24,521 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:24,521 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:24,521 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:24,521 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. started... 2023-11-26 15:54:24,521 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 905abcb77b8ecc225b5ac5b6464c5c8a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:24,534 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231df6e8c270d534121927d92d4dea6a70e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231df6e8c270d534121927d92d4dea6a70e 2023-11-26 15:54:24,940 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/0c4aa75aff2d455ab07c2c6301741422 2023-11-26 15:54:24,945 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/0c4aa75aff2d455ab07c2c6301741422 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/0c4aa75aff2d455ab07c2c6301741422 2023-11-26 15:54:24,949 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/0c4aa75aff2d455ab07c2c6301741422, entries=1, sequenceid=25, filesize=5.0 K 2023-11-26 15:54:24,949 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 905abcb77b8ecc225b5ac5b6464c5c8a in 428ms, sequenceid=25, compaction requested=true 2023-11-26 15:54:24,949 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:24,950 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:24,950 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:24,950 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:24,950 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,950 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-26 15:54:24,950 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-26 15:54:24,952 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,952 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:24,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:24,953 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,953 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:24,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:24,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:24,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:24,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-26 15:54:24,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20237b25[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:24,954 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-26 15:54:24,954 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,956 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,956 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-26 15:54:24,956 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-26 15:54:24,956 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:24,956 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,956 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:24,957 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-26 15:54:24,957 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,957 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:24,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:24,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:24,958 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-26 15:54:24,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:24,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:24,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:24,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:24,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-26 15:54:24,960 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-26 15:54:24,960 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:24,960 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:24,960 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,960 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:24,962 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,962 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:24,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:24,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,962 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:24,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:24,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:24,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:24,963 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:24,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,964 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:24,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,967 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,967 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,968 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,968 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:24,968 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:24,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:24,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:24,968 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,968 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:24,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:24,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:24,968 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:24,968 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:24,968 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:24,968 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:24,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:24,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:24,968 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,068 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:25,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:25,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:25,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:25,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,075 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:25,075 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:25,075 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-26 15:54:25,075 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-26 15:54:25,076 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,076 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,077 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:25,077 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:25,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:25,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:25,077 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:25,077 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:25,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:25,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,078 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,078 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-26 15:54:25,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,078 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-26 15:54:25,078 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:25,078 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-26 15:54:25,079 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:25,079 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:25,079 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:25,079 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. started... 2023-11-26 15:54:25,079 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 905abcb77b8ecc225b5ac5b6464c5c8a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:25,090 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601012e14751a215341cc8d5f4522fb81ecf3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601012e14751a215341cc8d5f4522fb81ecf3 2023-11-26 15:54:25,496 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/7f2c663c098248a5b378eb785c09b46e 2023-11-26 15:54:25,500 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/7f2c663c098248a5b378eb785c09b46e as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/7f2c663c098248a5b378eb785c09b46e 2023-11-26 15:54:25,505 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/7f2c663c098248a5b378eb785c09b46e, entries=1, sequenceid=29, filesize=5.0 K 2023-11-26 15:54:25,505 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 905abcb77b8ecc225b5ac5b6464c5c8a in 426ms, sequenceid=29, compaction requested=true 2023-11-26 15:54:25,506 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:25,506 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:25,506 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:25,506 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:25,506 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:25,506 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-26 15:54:25,506 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-26 15:54:25,507 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,507 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:25,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:25,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:25,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:25,508 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,508 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:25,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:25,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:25,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:25,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:25,509 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-26 15:54:25,510 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c165355[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:25,510 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-26 15:54:25,510 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,511 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,511 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-26 15:54:25,511 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-26 15:54:25,511 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:25,511 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:25,511 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:25,521 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-26 15:54:25,521 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:25,521 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:25,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:25,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:25,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:25,521 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-26 15:54:25,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:25,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:25,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:25,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:25,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:25,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:25,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-26 15:54:25,524 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-26 15:54:25,524 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:25,524 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:25,524 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,524 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:25,525 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,525 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:25,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:25,526 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:25,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:25,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:25,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:25,526 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:25,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:25,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:25,527 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:25,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:25,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:25,530 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:25,530 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:25,530 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:25,530 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:25,530 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:25,530 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:25,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:25,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:25,530 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:25,530 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,530 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:25,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:25,530 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,530 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:25,531 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:25,631 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:25,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:25,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:25,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:25,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,637 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:25,637 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:25,637 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-26 15:54:25,638 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-26 15:54:25,638 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,638 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,640 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:25,640 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:25,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:25,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:25,641 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:25,641 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:25,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:25,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,642 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,642 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-26 15:54:25,642 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:25,642 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-26 15:54:25,642 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:25,642 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-26 15:54:25,642 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:25,642 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:25,642 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:25,642 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. started... 2023-11-26 15:54:25,642 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 905abcb77b8ecc225b5ac5b6464c5c8a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:26,055 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010334835fd8aa684f0d8795d260c2f45be2 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010334835fd8aa684f0d8795d260c2f45be2 2023-11-26 15:54:26,460 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/a25b66886ee94823aa12b7875f6c696f 2023-11-26 15:54:26,465 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/a25b66886ee94823aa12b7875f6c696f as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/a25b66886ee94823aa12b7875f6c696f 2023-11-26 15:54:26,469 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/a25b66886ee94823aa12b7875f6c696f, entries=1, sequenceid=33, filesize=5.0 K 2023-11-26 15:54:26,470 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 905abcb77b8ecc225b5ac5b6464c5c8a in 828ms, sequenceid=33, compaction requested=true 2023-11-26 15:54:26,470 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:26,470 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:26,470 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:26,470 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:26,470 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:26,470 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-26 15:54:26,470 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-26 15:54:26,472 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,472 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:26,472 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,472 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:26,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:26,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:26,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-26 15:54:26,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c6d8d65[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:26,474 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-26 15:54:26,474 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,475 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,475 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-26 15:54:26,475 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-26 15:54:26,475 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:26,475 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:26,475 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:26,477 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-26 15:54:26,477 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:26,477 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:26,477 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-26 15:54:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:26,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-26 15:54:26,479 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-26 15:54:26,479 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:26,479 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:26,479 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,479 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:26,482 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,482 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,482 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:26,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:26,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:26,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:26,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:26,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:26,482 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:26,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:26,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:26,483 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:26,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:26,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:26,486 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:26,486 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:26,486 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,486 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:26,486 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:26,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:26,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:26,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:26,486 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:26,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-26 15:54:26,486 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:26,486 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,486 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,486 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,486 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:26,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:26,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:26,486 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:26,587 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:26,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:26,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:26,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:26,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,594 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:26,594 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:26,594 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-26 15:54:26,594 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-26 15:54:26,594 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,594 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,596 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:26,596 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:26,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:26,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:26,596 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:26,596 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:26,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:26,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,597 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,597 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-26 15:54:26,597 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:26,597 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-26 15:54:26,597 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:26,597 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-26 15:54:26,597 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:26,597 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:26,597 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:26,597 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. started... 2023-11-26 15:54:26,598 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 905abcb77b8ecc225b5ac5b6464c5c8a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:27,010 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907e8293fb415a740c78b98e3f54ab7160e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907e8293fb415a740c78b98e3f54ab7160e 2023-11-26 15:54:27,416 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/411391ccb04e463da547c6c45670d2df 2023-11-26 15:54:27,421 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/411391ccb04e463da547c6c45670d2df as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/411391ccb04e463da547c6c45670d2df 2023-11-26 15:54:27,425 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/411391ccb04e463da547c6c45670d2df, entries=1, sequenceid=37, filesize=5.0 K 2023-11-26 15:54:27,426 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 905abcb77b8ecc225b5ac5b6464c5c8a in 828ms, sequenceid=37, compaction requested=true 2023-11-26 15:54:27,426 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:27,426 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:27,426 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:27,426 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:27,426 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:27,426 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-26 15:54:27,426 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-26 15:54:27,428 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:27,428 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:27,428 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,428 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:27,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:27,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:27,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:27,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:27,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-26 15:54:27,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d5b2aa6[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:27,430 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-26 15:54:27,430 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,432 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,432 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-26 15:54:27,432 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-26 15:54:27,432 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:27,432 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:27,433 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:27,434 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-26 15:54:27,434 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:27,434 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:27,434 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-26 15:54:27,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:27,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:27,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:27,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:27,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:27,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:27,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:27,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:27,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:27,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-26 15:54:27,436 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-26 15:54:27,436 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:27,436 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:27,436 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,436 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:27,438 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,438 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:27,438 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:27,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:27,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:27,439 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:27,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:27,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:27,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:27,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:27,440 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:27,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:27,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:27,446 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:27,446 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,446 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:27,446 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,446 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:27,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:27,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:27,446 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:27,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:27,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:27,446 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:27,446 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,446 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,446 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,447 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:27,447 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:27,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:27,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:27,547 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:27,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:27,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:27,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:27,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,553 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:27,553 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:27,553 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-26 15:54:27,553 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-26 15:54:27,554 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,554 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,555 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:27,555 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:27,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:27,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:27,556 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:27,556 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:27,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,556 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:27,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,556 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,557 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-26 15:54:27,557 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:27,557 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-26 15:54:27,557 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:27,557 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-26 15:54:27,557 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:27,557 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:27,557 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:27,557 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. started... 2023-11-26 15:54:27,557 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 905abcb77b8ecc225b5ac5b6464c5c8a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:27,970 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120369a5f3a7f194b529b2f71db933bbb28 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120369a5f3a7f194b529b2f71db933bbb28 2023-11-26 15:54:28,376 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/73a80219562a4c0d9dd85afc2838face 2023-11-26 15:54:28,381 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/73a80219562a4c0d9dd85afc2838face as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/73a80219562a4c0d9dd85afc2838face 2023-11-26 15:54:28,385 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/73a80219562a4c0d9dd85afc2838face, entries=1, sequenceid=41, filesize=5.0 K 2023-11-26 15:54:28,386 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 905abcb77b8ecc225b5ac5b6464c5c8a in 829ms, sequenceid=41, compaction requested=true 2023-11-26 15:54:28,386 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:28,386 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:28,386 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:28,386 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:28,386 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:28,386 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-26 15:54:28,386 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-26 15:54:28,388 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,388 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:28,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:28,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:28,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:28,388 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,388 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:28,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:28,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:28,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:28,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:28,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-26 15:54:28,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69a847b[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:28,390 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-26 15:54:28,390 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,391 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,391 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-26 15:54:28,391 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-26 15:54:28,391 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:28,391 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:28,391 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:28,394 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-26 15:54:28,394 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:28,394 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:28,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:28,394 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-26 15:54:28,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:28,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:28,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:28,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:28,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:28,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:28,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:28,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:28,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-26 15:54:28,396 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-26 15:54:28,396 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:28,397 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:28,397 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,397 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:28,399 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,399 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,399 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:28,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:28,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:28,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:28,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:28,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:28,400 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:28,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:28,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:28,402 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:28,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:28,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:28,404 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:28,404 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,404 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:28,404 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,404 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:28,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:28,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-26 15:54:28,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:28,404 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:28,404 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:28,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:28,404 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,405 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,405 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,405 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:28,405 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:28,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:28,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:28,505 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:28,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:28,507 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33415] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:28,509 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-26 15:54:28,509 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-26 15:54:28,510 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:54:28,510 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701014668510 2023-11-26 15:54:28,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-26 15:54:28,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-26 15:54:28,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-26 15:54:28,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] zookeeper.ReadOnlyZKClient(139): Connect 0x50ff93cd to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:54:28,518 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7003522f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:54:28,519 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:29,356 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010304085fe559864dacad122162c44b7a91 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010304085fe559864dacad122162c44b7a91 2023-11-26 15:54:29,357 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-26 15:54:29,370 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:54:29,371 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60452, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:54:29,377 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-26 15:54:29,379 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-26 15:54:29,393 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/06103641b2d5443ea7e4057b955aaf2f first=Optional[r3] last=Optional[r6] 2023-11-26 15:54:29,393 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/06103641b2d5443ea7e4057b955aaf2f}] 2023-11-26 15:54:29,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/06103641b2d5443ea7e4057b955aaf2f for inclusion in 905abcb77b8ecc225b5ac5b6464c5c8a/family1 2023-11-26 15:54:29,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-26 15:54:29,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last= 2023-11-26 15:54:29,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:29,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/06103641b2d5443ea7e4057b955aaf2f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__u5holb6896tqipgm9gvdn7qfps6lai0v995vil2q5f9o0f3s7ccdri7bdm5jamop/family1/06103641b2d5443ea7e4057b955aaf2f 2023-11-26 15:54:29,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__u5holb6896tqipgm9gvdn7qfps6lai0v995vil2q5f9o0f3s7ccdri7bdm5jamop/family1/06103641b2d5443ea7e4057b955aaf2f as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/4f2169aaa6ba4bd3bc7c1fc77cb6aa12_SeqId_44_ 2023-11-26 15:54:29,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__u5holb6896tqipgm9gvdn7qfps6lai0v995vil2q5f9o0f3s7ccdri7bdm5jamop/family1/06103641b2d5443ea7e4057b955aaf2f into 905abcb77b8ecc225b5ac5b6464c5c8a/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/4f2169aaa6ba4bd3bc7c1fc77cb6aa12_SeqId_44_ - updating store file list. 2023-11-26 15:54:29,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/4f2169aaa6ba4bd3bc7c1fc77cb6aa12_SeqId_44_ into 905abcb77b8ecc225b5ac5b6464c5c8a/family1 2023-11-26 15:54:29,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__u5holb6896tqipgm9gvdn7qfps6lai0v995vil2q5f9o0f3s7ccdri7bdm5jamop/family1/06103641b2d5443ea7e4057b955aaf2f into 905abcb77b8ecc225b5ac5b6464c5c8a/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/4f2169aaa6ba4bd3bc7c1fc77cb6aa12_SeqId_44_) 2023-11-26 15:54:29,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__u5holb6896tqipgm9gvdn7qfps6lai0v995vil2q5f9o0f3s7ccdri7bdm5jamop/family1/06103641b2d5443ea7e4057b955aaf2f 2023-11-26 15:54:29,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-26 15:54:29,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-26 15:54:29,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(1912): 905abcb77b8ecc225b5ac5b6464c5c8a/family1 is initiating minor compaction 2023-11-26 15:54:29,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3c662f7e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:54:29,412 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 905abcb77b8ecc225b5ac5b6464c5c8a/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:29,412 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/bd13d4452dc14194812dc4af964ed248, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/850d778c06be4487b690a2806ac02d4e, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/09ad461be4fa4a4e9d3aa5247dc01b45, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/26abcb567ea346709cd611db3a47640f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/0c4aa75aff2d455ab07c2c6301741422, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/7f2c663c098248a5b378eb785c09b46e, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/a25b66886ee94823aa12b7875f6c696f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/411391ccb04e463da547c6c45670d2df, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/73a80219562a4c0d9dd85afc2838face, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/4f2169aaa6ba4bd3bc7c1fc77cb6aa12_SeqId_44_] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp, totalSize=50.4 K 2023-11-26 15:54:29,412 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting bd13d4452dc14194812dc4af964ed248, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-26 15:54:29,412 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 850d778c06be4487b690a2806ac02d4e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-26 15:54:29,412 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 09ad461be4fa4a4e9d3aa5247dc01b45, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-26 15:54:29,412 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 26abcb567ea346709cd611db3a47640f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-26 15:54:29,412 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 0c4aa75aff2d455ab07c2c6301741422, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-26 15:54:29,412 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 7f2c663c098248a5b378eb785c09b46e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-26 15:54:29,412 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting a25b66886ee94823aa12b7875f6c696f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-26 15:54:29,412 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 411391ccb04e463da547c6c45670d2df, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-26 15:54:29,412 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 73a80219562a4c0d9dd85afc2838face, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-26 15:54:29,412 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 4f2169aaa6ba4bd3bc7c1fc77cb6aa12_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-26 15:54:29,414 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-26 15:54:29,415 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:29,416 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512288e9dc3393a3a4f2c8cffb961d7bb66f4 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512288e9dc3393a3a4f2c8cffb961d7bb66f4 2023-11-26 15:54:29,418 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231df6e8c270d534121927d92d4dea6a70e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231df6e8c270d534121927d92d4dea6a70e 2023-11-26 15:54:29,419 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601012e14751a215341cc8d5f4522fb81ecf3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601012e14751a215341cc8d5f4522fb81ecf3 2023-11-26 15:54:29,420 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010334835fd8aa684f0d8795d260c2f45be2 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010334835fd8aa684f0d8795d260c2f45be2 2023-11-26 15:54:29,420 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-11-26 15:54:29,420 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-26 15:54:29,421 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:29,421 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:29,421 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:29,421 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:29,421 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:29,421 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:29,421 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:29,421 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:29,436 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] throttle.PressureAwareThroughputController(145): 905abcb77b8ecc225b5ac5b6464c5c8a#family1#compaction#61 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:54:30,251 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/75f0b71c2275417e9bf9c63bd99831c8 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/75f0b71c2275417e9bf9c63bd99831c8 2023-11-26 15:54:30,257 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 905abcb77b8ecc225b5ac5b6464c5c8a/family1 of 905abcb77b8ecc225b5ac5b6464c5c8a into 75f0b71c2275417e9bf9c63bd99831c8(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:54:30,257 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:30,257 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1701014069412; duration=0sec 2023-11-26 15:54:30,257 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:54:30,269 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052393f8fe81af4131b250e88e95bd1903 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512052393f8fe81af4131b250e88e95bd1903 2023-11-26 15:54:30,270 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-26 15:54:30,294 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c10a71d90a8b4fe1bb3a382c313cab54 first=Optional[r00] last=Optional[r2] 2023-11-26 15:54:30,295 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c10a71d90a8b4fe1bb3a382c313cab54}] 2023-11-26 15:54:30,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c10a71d90a8b4fe1bb3a382c313cab54 for inclusion in 905abcb77b8ecc225b5ac5b6464c5c8a/family1 2023-11-26 15:54:30,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-26 15:54:30,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last= 2023-11-26 15:54:30,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:30,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c10a71d90a8b4fe1bb3a382c313cab54 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__vdits7bpahn8m6iisv1iq52ju7ko7n73dgcqp3t7s0838epcmiq9ol8r0d5vme5v/family1/c10a71d90a8b4fe1bb3a382c313cab54 2023-11-26 15:54:30,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__vdits7bpahn8m6iisv1iq52ju7ko7n73dgcqp3t7s0838epcmiq9ol8r0d5vme5v/family1/c10a71d90a8b4fe1bb3a382c313cab54 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/3c44941a59054a319d1f472dd33d1bbf_SeqId_47_ 2023-11-26 15:54:30,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__vdits7bpahn8m6iisv1iq52ju7ko7n73dgcqp3t7s0838epcmiq9ol8r0d5vme5v/family1/c10a71d90a8b4fe1bb3a382c313cab54 into 905abcb77b8ecc225b5ac5b6464c5c8a/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/3c44941a59054a319d1f472dd33d1bbf_SeqId_47_ - updating store file list. 2023-11-26 15:54:30,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/3c44941a59054a319d1f472dd33d1bbf_SeqId_47_ into 905abcb77b8ecc225b5ac5b6464c5c8a/family1 2023-11-26 15:54:30,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__vdits7bpahn8m6iisv1iq52ju7ko7n73dgcqp3t7s0838epcmiq9ol8r0d5vme5v/family1/c10a71d90a8b4fe1bb3a382c313cab54 into 905abcb77b8ecc225b5ac5b6464c5c8a/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/3c44941a59054a319d1f472dd33d1bbf_SeqId_47_) 2023-11-26 15:54:30,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__vdits7bpahn8m6iisv1iq52ju7ko7n73dgcqp3t7s0838epcmiq9ol8r0d5vme5v/family1/c10a71d90a8b4fe1bb3a382c313cab54 2023-11-26 15:54:30,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-26 15:54:30,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-26 15:54:30,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(1912): 905abcb77b8ecc225b5ac5b6464c5c8a/family1 is initiating minor compaction (all files) 2023-11-26 15:54:30,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5f0349a8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:54:30,309 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 905abcb77b8ecc225b5ac5b6464c5c8a/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:30,309 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/0ac931ab6f294a75bcf9af76be01da57, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/75f0b71c2275417e9bf9c63bd99831c8, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/3c44941a59054a319d1f472dd33d1bbf_SeqId_47_] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp, totalSize=390.1 K 2023-11-26 15:54:30,310 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 0ac931ab6f294a75bcf9af76be01da57, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823935 2023-11-26 15:54:30,310 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 75f0b71c2275417e9bf9c63bd99831c8, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223935 2023-11-26 15:54:30,311 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 3c44941a59054a319d1f472dd33d1bbf_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878823935 2023-11-26 15:54:30,311 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-26 15:54:30,311 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:30,313 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130e7a70f8a42f441ecbd425300b019d1aa to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130e7a70f8a42f441ecbd425300b019d1aa 2023-11-26 15:54:30,320 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512017d0ed83b9a35491d8bac9d4907524143 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512017d0ed83b9a35491d8bac9d4907524143 2023-11-26 15:54:30,328 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/bd13d4452dc14194812dc4af964ed248, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/850d778c06be4487b690a2806ac02d4e, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/09ad461be4fa4a4e9d3aa5247dc01b45, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/26abcb567ea346709cd611db3a47640f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/0c4aa75aff2d455ab07c2c6301741422, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/7f2c663c098248a5b378eb785c09b46e, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/a25b66886ee94823aa12b7875f6c696f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/411391ccb04e463da547c6c45670d2df, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/73a80219562a4c0d9dd85afc2838face, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/4f2169aaa6ba4bd3bc7c1fc77cb6aa12_SeqId_44_] to archive 2023-11-26 15:54:30,329 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205a541d6abed744e0ea9028db066c0682f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205a541d6abed744e0ea9028db066c0682f 2023-11-26 15:54:30,329 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-11-26 15:54:30,329 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-26 15:54:30,329 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:30,330 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:30,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-26 15:54:30,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:54:30,331 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-26 15:54:30,333 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8230 sec 2023-11-26 15:54:30,333 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/bd13d4452dc14194812dc4af964ed248 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/bd13d4452dc14194812dc4af964ed248 2023-11-26 15:54:30,334 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/850d778c06be4487b690a2806ac02d4e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/850d778c06be4487b690a2806ac02d4e 2023-11-26 15:54:30,335 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/09ad461be4fa4a4e9d3aa5247dc01b45 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/09ad461be4fa4a4e9d3aa5247dc01b45 2023-11-26 15:54:30,337 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/26abcb567ea346709cd611db3a47640f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/26abcb567ea346709cd611db3a47640f 2023-11-26 15:54:30,338 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/0c4aa75aff2d455ab07c2c6301741422 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/0c4aa75aff2d455ab07c2c6301741422 2023-11-26 15:54:30,339 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/7f2c663c098248a5b378eb785c09b46e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/7f2c663c098248a5b378eb785c09b46e 2023-11-26 15:54:30,341 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/a25b66886ee94823aa12b7875f6c696f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/a25b66886ee94823aa12b7875f6c696f 2023-11-26 15:54:30,341 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] throttle.PressureAwareThroughputController(145): 905abcb77b8ecc225b5ac5b6464c5c8a#family1#compaction#62 average throughput is 22.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:54:30,342 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/411391ccb04e463da547c6c45670d2df to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/411391ccb04e463da547c6c45670d2df 2023-11-26 15:54:30,343 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/73a80219562a4c0d9dd85afc2838face to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/73a80219562a4c0d9dd85afc2838face 2023-11-26 15:54:30,345 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/4f2169aaa6ba4bd3bc7c1fc77cb6aa12_SeqId_44_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/4f2169aaa6ba4bd3bc7c1fc77cb6aa12_SeqId_44_ 2023-11-26 15:54:30,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-26 15:54:30,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:30,830 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-26 15:54:30,831 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-26 15:54:30,831 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-26 15:54:30,833 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-26 15:54:30,835 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=905abcb77b8ecc225b5ac5b6464c5c8a, REOPEN/MOVE}] 2023-11-26 15:54:30,836 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=905abcb77b8ecc225b5ac5b6464c5c8a, REOPEN/MOVE 2023-11-26 15:54:30,837 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=905abcb77b8ecc225b5ac5b6464c5c8a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:30,837 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701014070836"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014070836"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014070836"}]},"ts":"1701014070836"} 2023-11-26 15:54:30,838 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 905abcb77b8ecc225b5ac5b6464c5c8a, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:54:30,989 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:30,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:30,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 905abcb77b8ecc225b5ac5b6464c5c8a, disabling compactions & flushes 2023-11-26 15:54:30,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:31,558 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/.tmp/family1/0202a1c3cac94fc9a2be5b4dbe748c6c as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/0202a1c3cac94fc9a2be5b4dbe748c6c 2023-11-26 15:54:31,563 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 905abcb77b8ecc225b5ac5b6464c5c8a/family1 of 905abcb77b8ecc225b5ac5b6464c5c8a into 0202a1c3cac94fc9a2be5b4dbe748c6c(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-26 15:54:31,563 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:31,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:31,563 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1701014070309; duration=1sec 2023-11-26 15:54:31,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:31,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. after waiting 0 ms 2023-11-26 15:54:31,563 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:54:31,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:31,564 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/0ac931ab6f294a75bcf9af76be01da57, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/75f0b71c2275417e9bf9c63bd99831c8, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/3c44941a59054a319d1f472dd33d1bbf_SeqId_47_] to archive 2023-11-26 15:54:31,564 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:31,566 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/0ac931ab6f294a75bcf9af76be01da57 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/0ac931ab6f294a75bcf9af76be01da57 2023-11-26 15:54:31,567 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/75f0b71c2275417e9bf9c63bd99831c8 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/75f0b71c2275417e9bf9c63bd99831c8 2023-11-26 15:54:31,568 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/3c44941a59054a319d1f472dd33d1bbf_SeqId_47_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/3c44941a59054a319d1f472dd33d1bbf_SeqId_47_ 2023-11-26 15:54:31,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-26 15:54:31,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:31,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:31,574 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: 905abcb77b8ecc225b5ac5b6464c5c8a to self. 2023-11-26 15:54:31,575 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:31,576 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=905abcb77b8ecc225b5ac5b6464c5c8a, regionState=CLOSED 2023-11-26 15:54:31,576 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701014071576"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014071576"}]},"ts":"1701014071576"} 2023-11-26 15:54:31,578 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=46, resume processing ppid=45 2023-11-26 15:54:31,578 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 905abcb77b8ecc225b5ac5b6464c5c8a, server=jenkins-hbase4.apache.org,41861,1701014000937 in 739 msec 2023-11-26 15:54:31,579 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=905abcb77b8ecc225b5ac5b6464c5c8a, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=true 2023-11-26 15:54:31,729 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=905abcb77b8ecc225b5ac5b6464c5c8a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:31,729 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701014071729"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014071729"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014071729"}]},"ts":"1701014071729"} 2023-11-26 15:54:31,731 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 905abcb77b8ecc225b5ac5b6464c5c8a, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:54:31,882 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:31,885 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:31,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 905abcb77b8ecc225b5ac5b6464c5c8a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.', STARTKEY => '', ENDKEY => ''} 2023-11-26 15:54:31,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:31,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:31,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:31,886 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:31,887 INFO [StoreOpener-905abcb77b8ecc225b5ac5b6464c5c8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:31,888 DEBUG [StoreOpener-905abcb77b8ecc225b5ac5b6464c5c8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1 2023-11-26 15:54:31,888 DEBUG [StoreOpener-905abcb77b8ecc225b5ac5b6464c5c8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1 2023-11-26 15:54:31,889 INFO [StoreOpener-905abcb77b8ecc225b5ac5b6464c5c8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 905abcb77b8ecc225b5ac5b6464c5c8a columnFamilyName family1 2023-11-26 15:54:31,893 DEBUG [StoreOpener-905abcb77b8ecc225b5ac5b6464c5c8a-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/0202a1c3cac94fc9a2be5b4dbe748c6c 2023-11-26 15:54:31,893 INFO [StoreOpener-905abcb77b8ecc225b5ac5b6464c5c8a-1] regionserver.HStore(310): Store=905abcb77b8ecc225b5ac5b6464c5c8a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:54:31,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:31,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:31,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:31,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 905abcb77b8ecc225b5ac5b6464c5c8a; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73205070, jitterRate=0.09084054827690125}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-26 15:54:31,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:31,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a., pid=47, masterSystemTime=1701014071882 2023-11-26 15:54:31,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:31,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:31,902 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=905abcb77b8ecc225b5ac5b6464c5c8a, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:31,902 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701014071901"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014071901"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014071901"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014071901"}]},"ts":"1701014071901"} 2023-11-26 15:54:31,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=47, resume processing ppid=45 2023-11-26 15:54:31,904 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 905abcb77b8ecc225b5ac5b6464c5c8a, server=jenkins-hbase4.apache.org,41861,1701014000937 in 172 msec 2023-11-26 15:54:31,906 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=45, resume processing ppid=44 2023-11-26 15:54:31,906 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=905abcb77b8ecc225b5ac5b6464c5c8a, REOPEN/MOVE in 1.0690 sec 2023-11-26 15:54:31,908 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=44, resume processing ppid=43 2023-11-26 15:54:31,908 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0740 sec 2023-11-26 15:54:31,909 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.4890 sec 2023-11-26 15:54:31,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-11-26 15:54:31,911 INFO [Listener at localhost/43645] compactions.TestMobCompactor(278): alter status finished 2023-11-26 15:54:31,912 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33415] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:31,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-26 15:54:31,914 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-26 15:54:31,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:54:31,915 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701014671915 2023-11-26 15:54:31,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-26 15:54:31,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-26 15:54:31,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-26 15:54:31,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] zookeeper.ReadOnlyZKClient(139): Connect 0x366fea34 to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:54:31,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c9754fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:54:31,923 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:31,923 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:31,923 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:31,923 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:31,923 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:32,753 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282895d624d97042b7924c40b24cffe0e0 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511282895d624d97042b7924c40b24cffe0e0 2023-11-26 15:54:32,753 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-26 15:54:32,766 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:54:32,767 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:54:32,775 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-26 15:54:32,777 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-26 15:54:32,788 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a345a08efdfe4bdeb17318091230afcf first=Optional[r05] last=Optional[r8] 2023-11-26 15:54:32,788 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=51 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a345a08efdfe4bdeb17318091230afcf}] 2023-11-26 15:54:32,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a345a08efdfe4bdeb17318091230afcf for inclusion in 905abcb77b8ecc225b5ac5b6464c5c8a/family1 2023-11-26 15:54:32,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-26 15:54:32,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last= 2023-11-26 15:54:32,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:32,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a345a08efdfe4bdeb17318091230afcf to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ta6k8l10sd37vj6kcbq1fjithhdhq5isf5uj00q7k30nggfj2iatvrndrqdj3jtd/family1/a345a08efdfe4bdeb17318091230afcf 2023-11-26 15:54:32,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ta6k8l10sd37vj6kcbq1fjithhdhq5isf5uj00q7k30nggfj2iatvrndrqdj3jtd/family1/a345a08efdfe4bdeb17318091230afcf as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/6648ae94c3b14b1ab4d3ccd0e167a6be_SeqId_53_ 2023-11-26 15:54:32,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ta6k8l10sd37vj6kcbq1fjithhdhq5isf5uj00q7k30nggfj2iatvrndrqdj3jtd/family1/a345a08efdfe4bdeb17318091230afcf into 905abcb77b8ecc225b5ac5b6464c5c8a/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/6648ae94c3b14b1ab4d3ccd0e167a6be_SeqId_53_ - updating store file list. 2023-11-26 15:54:32,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/6648ae94c3b14b1ab4d3ccd0e167a6be_SeqId_53_ into 905abcb77b8ecc225b5ac5b6464c5c8a/family1 2023-11-26 15:54:32,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ta6k8l10sd37vj6kcbq1fjithhdhq5isf5uj00q7k30nggfj2iatvrndrqdj3jtd/family1/a345a08efdfe4bdeb17318091230afcf into 905abcb77b8ecc225b5ac5b6464c5c8a/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/6648ae94c3b14b1ab4d3ccd0e167a6be_SeqId_53_) 2023-11-26 15:54:32,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ta6k8l10sd37vj6kcbq1fjithhdhq5isf5uj00q7k30nggfj2iatvrndrqdj3jtd/family1/a345a08efdfe4bdeb17318091230afcf 2023-11-26 15:54:32,807 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-26 15:54:32,808 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:32,809 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120369a5f3a7f194b529b2f71db933bbb28 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120369a5f3a7f194b529b2f71db933bbb28 2023-11-26 15:54:32,810 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128fe7cfaf8f6814622b0cc8a2e6415d626 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128fe7cfaf8f6814622b0cc8a2e6415d626 2023-11-26 15:54:32,810 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-11-26 15:54:32,810 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-26 15:54:32,812 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:32,812 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:32,812 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:32,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-26 15:54:32,812 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:54:32,813 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-26 15:54:32,814 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 900 msec 2023-11-26 15:54:32,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-26 15:54:32,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:33,282 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-26 15:54:33,283 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-26 15:54:33,283 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-26 15:54:33,286 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-26 15:54:33,288 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=905abcb77b8ecc225b5ac5b6464c5c8a, REOPEN/MOVE}] 2023-11-26 15:54:33,289 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=905abcb77b8ecc225b5ac5b6464c5c8a, REOPEN/MOVE 2023-11-26 15:54:33,290 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=905abcb77b8ecc225b5ac5b6464c5c8a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:33,290 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701014073290"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014073290"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014073290"}]},"ts":"1701014073290"} 2023-11-26 15:54:33,291 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 905abcb77b8ecc225b5ac5b6464c5c8a, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:54:33,443 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:33,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:33,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 905abcb77b8ecc225b5ac5b6464c5c8a, disabling compactions & flushes 2023-11-26 15:54:33,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:33,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:33,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. after waiting 0 ms 2023-11-26 15:54:33,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:33,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-26 15:54:33,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:33,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:33,450 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: 905abcb77b8ecc225b5ac5b6464c5c8a to self. 2023-11-26 15:54:33,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:33,452 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=905abcb77b8ecc225b5ac5b6464c5c8a, regionState=CLOSED 2023-11-26 15:54:33,452 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701014073452"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014073452"}]},"ts":"1701014073452"} 2023-11-26 15:54:33,454 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=52, resume processing ppid=51 2023-11-26 15:54:33,454 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 905abcb77b8ecc225b5ac5b6464c5c8a, server=jenkins-hbase4.apache.org,41861,1701014000937 in 162 msec 2023-11-26 15:54:33,455 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=905abcb77b8ecc225b5ac5b6464c5c8a, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=true 2023-11-26 15:54:33,605 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=905abcb77b8ecc225b5ac5b6464c5c8a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:33,605 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701014073605"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014073605"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014073605"}]},"ts":"1701014073605"} 2023-11-26 15:54:33,607 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 905abcb77b8ecc225b5ac5b6464c5c8a, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:54:33,759 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:33,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:33,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 905abcb77b8ecc225b5ac5b6464c5c8a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.', STARTKEY => '', ENDKEY => ''} 2023-11-26 15:54:33,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:33,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:33,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:33,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:33,763 INFO [StoreOpener-905abcb77b8ecc225b5ac5b6464c5c8a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:33,764 DEBUG [StoreOpener-905abcb77b8ecc225b5ac5b6464c5c8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1 2023-11-26 15:54:33,764 DEBUG [StoreOpener-905abcb77b8ecc225b5ac5b6464c5c8a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1 2023-11-26 15:54:33,765 INFO [StoreOpener-905abcb77b8ecc225b5ac5b6464c5c8a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 905abcb77b8ecc225b5ac5b6464c5c8a columnFamilyName family1 2023-11-26 15:54:33,771 DEBUG [StoreOpener-905abcb77b8ecc225b5ac5b6464c5c8a-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/0202a1c3cac94fc9a2be5b4dbe748c6c 2023-11-26 15:54:33,774 DEBUG [StoreOpener-905abcb77b8ecc225b5ac5b6464c5c8a-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/family1/6648ae94c3b14b1ab4d3ccd0e167a6be_SeqId_53_ 2023-11-26 15:54:33,774 INFO [StoreOpener-905abcb77b8ecc225b5ac5b6464c5c8a-1] regionserver.HStore(310): Store=905abcb77b8ecc225b5ac5b6464c5c8a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:54:33,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:33,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:33,778 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:54:33,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 905abcb77b8ecc225b5ac5b6464c5c8a; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61310385, jitterRate=-0.08640407025814056}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-26 15:54:33,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:54:33,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a., pid=53, masterSystemTime=1701014073759 2023-11-26 15:54:33,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:33,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:54:33,781 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=905abcb77b8ecc225b5ac5b6464c5c8a, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:33,782 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701014073781"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014073781"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014073781"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014073781"}]},"ts":"1701014073781"} 2023-11-26 15:54:33,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=53, resume processing ppid=51 2023-11-26 15:54:33,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 905abcb77b8ecc225b5ac5b6464c5c8a, server=jenkins-hbase4.apache.org,41861,1701014000937 in 176 msec 2023-11-26 15:54:33,785 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=51, resume processing ppid=50 2023-11-26 15:54:33,785 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=905abcb77b8ecc225b5ac5b6464c5c8a, REOPEN/MOVE in 496 msec 2023-11-26 15:54:33,787 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=50, resume processing ppid=49 2023-11-26 15:54:33,787 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 501 msec 2023-11-26 15:54:33,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 915 msec 2023-11-26 15:54:33,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-11-26 15:54:33,790 INFO [Listener at localhost/43645] compactions.TestMobCompactor(278): alter status finished 2023-11-26 15:54:33,791 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33415] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-26 15:54:33,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-26 15:54:33,793 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-26 15:54:33,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:54:33,794 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701014673794 2023-11-26 15:54:33,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-26 15:54:33,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-26 15:54:33,795 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-26 15:54:33,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] zookeeper.ReadOnlyZKClient(139): Connect 0x6e61fcfc to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:54:33,800 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8b76578, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:54:33,801 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:33,801 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:33,801 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:33,801 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:33,801 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:33,801 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:33,801 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:33,801 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-26 15:54:33,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-26 15:54:33,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:54:33,803 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-26 15:54:33,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 11 msec 2023-11-26 15:54:33,849 INFO [Listener at localhost/43645] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=254 (was 268), OpenFileDescriptor=665 (was 660) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=194 (was 220), ProcessCount=171 (was 171), AvailableMemoryMB=8394 (was 8415) 2023-11-26 15:54:33,860 INFO [Listener at localhost/43645] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=254, OpenFileDescriptor=665, MaxFileDescriptor=60000, SystemLoadAverage=194, ProcessCount=171, AvailableMemoryMB=8393 2023-11-26 15:54:33,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-26 15:54:33,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:33,864 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-11-26 15:54:33,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-11-26 15:54:33,865 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-26 15:54:33,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-26 15:54:33,866 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:33,866 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac empty. 2023-11-26 15:54:33,867 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:33,867 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-11-26 15:54:33,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-26 15:54:34,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-26 15:54:34,275 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-26 15:54:34,277 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => ea3a647b9f914561bb8e56dcb1bd89ac, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:54:34,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-26 15:54:34,683 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:34,683 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing ea3a647b9f914561bb8e56dcb1bd89ac, disabling compactions & flushes 2023-11-26 15:54:34,683 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:34,683 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:34,683 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. after waiting 0 ms 2023-11-26 15:54:34,683 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:34,683 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:34,683 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:34,686 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-11-26 15:54:34,687 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701014074686"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014074686"}]},"ts":"1701014074686"} 2023-11-26 15:54:34,688 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-26 15:54:34,688 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-26 15:54:34,689 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014074688"}]},"ts":"1701014074688"} 2023-11-26 15:54:34,689 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-11-26 15:54:34,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ea3a647b9f914561bb8e56dcb1bd89ac, ASSIGN}] 2023-11-26 15:54:34,695 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ea3a647b9f914561bb8e56dcb1bd89ac, ASSIGN 2023-11-26 15:54:34,696 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ea3a647b9f914561bb8e56dcb1bd89ac, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:54:34,847 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=ea3a647b9f914561bb8e56dcb1bd89ac, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:34,847 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701014074847"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014074847"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014074847"}]},"ts":"1701014074847"} 2023-11-26 15:54:34,849 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure ea3a647b9f914561bb8e56dcb1bd89ac, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:54:34,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-26 15:54:35,000 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:35,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:35,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ea3a647b9f914561bb8e56dcb1bd89ac, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac.', STARTKEY => '', ENDKEY => ''} 2023-11-26 15:54:35,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:35,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:35,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:35,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:35,004 INFO [StoreOpener-ea3a647b9f914561bb8e56dcb1bd89ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:35,006 DEBUG [StoreOpener-ea3a647b9f914561bb8e56dcb1bd89ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1 2023-11-26 15:54:35,006 DEBUG [StoreOpener-ea3a647b9f914561bb8e56dcb1bd89ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1 2023-11-26 15:54:35,006 INFO [StoreOpener-ea3a647b9f914561bb8e56dcb1bd89ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea3a647b9f914561bb8e56dcb1bd89ac columnFamilyName family1 2023-11-26 15:54:35,008 INFO [StoreOpener-ea3a647b9f914561bb8e56dcb1bd89ac-1] regionserver.HStore(310): Store=ea3a647b9f914561bb8e56dcb1bd89ac/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:54:35,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:35,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:35,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:35,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:54:35,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ea3a647b9f914561bb8e56dcb1bd89ac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67211549, jitterRate=0.0015301257371902466}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-26 15:54:35,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:35,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac., pid=57, masterSystemTime=1701014075000 2023-11-26 15:54:35,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:35,017 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:35,017 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=ea3a647b9f914561bb8e56dcb1bd89ac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:35,017 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701014075017"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014075017"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014075017"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014075017"}]},"ts":"1701014075017"} 2023-11-26 15:54:35,019 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=57, resume processing ppid=56 2023-11-26 15:54:35,020 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure ea3a647b9f914561bb8e56dcb1bd89ac, server=jenkins-hbase4.apache.org,41861,1701014000937 in 170 msec 2023-11-26 15:54:35,021 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=56, resume processing ppid=55 2023-11-26 15:54:35,021 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ea3a647b9f914561bb8e56dcb1bd89ac, ASSIGN in 326 msec 2023-11-26 15:54:35,021 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-26 15:54:35,022 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014075021"}]},"ts":"1701014075021"} 2023-11-26 15:54:35,023 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-11-26 15:54:35,025 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-11-26 15:54:35,026 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1630 sec 2023-11-26 15:54:35,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-26 15:54:35,971 INFO [Listener at localhost/43645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-11-26 15:54:35,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:35,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:35,999 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:35,999 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:35,999 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-26 15:54:35,999 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-26 15:54:35,999 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,000 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,001 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:36,001 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:36,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:36,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:36,001 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:36,001 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:36,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,002 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:36,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,002 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,005 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,005 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-26 15:54:36,005 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:36,005 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-26 15:54:36,007 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:36,007 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:36,007 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:36,007 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. started... 2023-11-26 15:54:36,008 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ea3a647b9f914561bb8e56dcb1bd89ac 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-26 15:54:36,433 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f2a593ddbe9d430887c175a25edc2130 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130f2a593ddbe9d430887c175a25edc2130 2023-11-26 15:54:36,603 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e61fcfc to 127.0.0.1:58210 2023-11-26 15:54:36,603 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:54:36,603 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-26 15:54:36,603 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x366fea34 to 127.0.0.1:58210 2023-11-26 15:54:36,603 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:54:36,603 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-26 15:54:36,603 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b986e73 to 127.0.0.1:58210 2023-11-26 15:54:36,603 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:54:36,603 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-26 15:54:36,603 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x698476f0 to 127.0.0.1:58210 2023-11-26 15:54:36,603 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:54:36,604 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-26 15:54:36,604 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x319bf77e to 127.0.0.1:58210 2023-11-26 15:54:36,604 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:54:36,604 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-26 15:54:36,604 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50ff93cd to 127.0.0.1:58210 2023-11-26 15:54:36,604 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:54:36,838 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/e31d0b4964614a8a8d637bd4d73516ac 2023-11-26 15:54:36,843 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/e31d0b4964614a8a8d637bd4d73516ac as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/e31d0b4964614a8a8d637bd4d73516ac 2023-11-26 15:54:36,846 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/e31d0b4964614a8a8d637bd4d73516ac, entries=1000, sequenceid=5, filesize=190.5 K 2023-11-26 15:54:36,847 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for ea3a647b9f914561bb8e56dcb1bd89ac in 839ms, sequenceid=5, compaction requested=false 2023-11-26 15:54:36,847 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:36,848 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:36,848 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:36,848 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:36,848 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:36,848 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:36,848 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-26 15:54:36,848 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-26 15:54:36,850 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:36,850 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:36,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:36,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:36,850 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,850 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:36,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:36,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:36,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:36,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:36,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-26 15:54:36,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1808f306[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:36,852 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-26 15:54:36,852 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,853 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,853 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-26 15:54:36,853 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-26 15:54:36,853 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:36,853 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:36,853 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:36,864 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-26 15:54:36,864 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:36,864 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:36,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:36,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:36,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:36,864 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-26 15:54:36,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:36,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:36,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:36,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:36,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:36,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:36,867 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-26 15:54:36,867 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-26 15:54:36,867 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:36,867 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:36,867 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,867 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:36,869 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,869 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,869 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:36,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:36,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:36,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:36,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:36,869 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:36,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:36,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:36,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,871 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:36,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:36,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:36,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:36,873 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:36,873 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:36,873 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:36,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-26 15:54:36,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:36,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:36,873 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:36,873 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,873 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:36,873 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:36,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:36,873 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,874 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,874 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:36,874 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:36,874 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:36,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:36,974 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:36,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:36,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:36,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:36,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,981 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:36,981 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:36,981 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-26 15:54:36,981 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-26 15:54:36,981 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,981 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,983 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:36,983 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:36,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:36,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:36,983 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:36,983 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:36,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:36,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,984 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,984 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-26 15:54:36,984 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:36,984 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-26 15:54:36,984 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:36,984 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-26 15:54:36,984 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:36,984 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:36,984 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:36,984 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. started... 2023-11-26 15:54:36,985 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ea3a647b9f914561bb8e56dcb1bd89ac 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-26 15:54:37,135 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-26 15:54:37,403 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112823a75cb8620649f085d21c86c32ffbc1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112823a75cb8620649f085d21c86c32ffbc1 2023-11-26 15:54:37,810 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/27b1621e837c450489224651c3b5cce4 2023-11-26 15:54:37,814 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/27b1621e837c450489224651c3b5cce4 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/27b1621e837c450489224651c3b5cce4 2023-11-26 15:54:37,818 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/27b1621e837c450489224651c3b5cce4, entries=1, sequenceid=9, filesize=5.0 K 2023-11-26 15:54:37,819 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for ea3a647b9f914561bb8e56dcb1bd89ac in 834ms, sequenceid=9, compaction requested=false 2023-11-26 15:54:37,819 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:37,819 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:37,819 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:37,819 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:37,819 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:37,819 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-26 15:54:37,819 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-26 15:54:37,822 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,822 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:37,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:37,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:37,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:37,822 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,822 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:37,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:37,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:37,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:37,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:37,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-26 15:54:37,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38ae53c7[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:37,824 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-26 15:54:37,824 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,825 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,825 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-26 15:54:37,825 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-26 15:54:37,825 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:37,825 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:37,825 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:37,826 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-26 15:54:37,826 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:37,826 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:37,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:37,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:37,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:37,826 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-26 15:54:37,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:37,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:37,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:37,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:37,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:37,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:37,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-26 15:54:37,829 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-26 15:54:37,829 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:37,829 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:37,829 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,829 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:37,831 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,831 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,831 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:37,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:37,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:37,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:37,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:37,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:37,831 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:37,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:37,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,833 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:37,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:37,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:37,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:37,836 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:37,836 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:37,836 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,836 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:37,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-26 15:54:37,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:37,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:37,836 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:37,836 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:37,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:37,837 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:37,837 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:37,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:37,837 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:37,837 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:37,837 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,837 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,937 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:37,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:37,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:37,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:37,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,943 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:37,943 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:37,943 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-26 15:54:37,943 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-26 15:54:37,944 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,944 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,945 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:37,945 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:37,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:37,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:37,946 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:37,946 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:37,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:37,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,947 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,947 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-26 15:54:37,947 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:37,947 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-26 15:54:37,947 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:37,947 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-26 15:54:37,947 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:37,947 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:37,947 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:37,947 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. started... 2023-11-26 15:54:37,947 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ea3a647b9f914561bb8e56dcb1bd89ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:38,359 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201fbaa4a2decda42bda902a66d4bee8b28 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201fbaa4a2decda42bda902a66d4bee8b28 2023-11-26 15:54:38,765 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/18a6bb891fed40c995211a7cbdba19d1 2023-11-26 15:54:38,769 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/18a6bb891fed40c995211a7cbdba19d1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/18a6bb891fed40c995211a7cbdba19d1 2023-11-26 15:54:38,773 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/18a6bb891fed40c995211a7cbdba19d1, entries=1, sequenceid=13, filesize=5.0 K 2023-11-26 15:54:38,774 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ea3a647b9f914561bb8e56dcb1bd89ac in 827ms, sequenceid=13, compaction requested=true 2023-11-26 15:54:38,774 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:38,774 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:38,774 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:38,774 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:38,774 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:38,774 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-26 15:54:38,774 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-26 15:54:38,776 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,776 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:38,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:38,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:38,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:38,777 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,777 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:38,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:38,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:38,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:38,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:38,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-26 15:54:38,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c44506e[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:38,778 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-26 15:54:38,778 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,779 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,779 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-26 15:54:38,779 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-26 15:54:38,779 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:38,780 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:38,780 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:38,782 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-26 15:54:38,782 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:38,782 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:38,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:38,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:38,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:38,782 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-26 15:54:38,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:38,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:38,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:38,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:38,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:38,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:38,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-26 15:54:38,785 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-26 15:54:38,785 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:38,785 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:38,785 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,785 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:38,789 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,789 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:38,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:38,789 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:38,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:38,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:38,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:38,790 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:38,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:38,791 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:38,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:38,796 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:38,796 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:38,796 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:38,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:38,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:38,796 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:38,796 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:38,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:38,796 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,796 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:38,796 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:38,796 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:38,796 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,797 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,797 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:38,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:38,897 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:38,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:38,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:38,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:38,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,903 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:38,903 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:38,903 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-26 15:54:38,903 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-26 15:54:38,904 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,904 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,909 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:38,909 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:38,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:38,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:38,909 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:38,909 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:38,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,910 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:38,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,910 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,910 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-26 15:54:38,910 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:38,910 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-26 15:54:38,910 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:38,910 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-26 15:54:38,910 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:38,911 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:38,911 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:38,911 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. started... 2023-11-26 15:54:38,911 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ea3a647b9f914561bb8e56dcb1bd89ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:39,329 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120537805e828c8947218f50c94b79bb69e1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120537805e828c8947218f50c94b79bb69e1 2023-11-26 15:54:39,735 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/314f66f533554c72a2129d14cf762f26 2023-11-26 15:54:39,740 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/314f66f533554c72a2129d14cf762f26 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/314f66f533554c72a2129d14cf762f26 2023-11-26 15:54:39,744 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/314f66f533554c72a2129d14cf762f26, entries=1, sequenceid=17, filesize=5.0 K 2023-11-26 15:54:39,744 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ea3a647b9f914561bb8e56dcb1bd89ac in 833ms, sequenceid=17, compaction requested=true 2023-11-26 15:54:39,744 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:39,744 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:39,745 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:39,745 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:39,745 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:39,745 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-26 15:54:39,745 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-26 15:54:39,746 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,746 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:39,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:39,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:39,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:39,747 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,747 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:39,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:39,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:39,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:39,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:39,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-26 15:54:39,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e2fbec1[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:39,748 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-26 15:54:39,749 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,750 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,750 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-26 15:54:39,750 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-26 15:54:39,750 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:39,750 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:39,750 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:39,751 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-26 15:54:39,751 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:39,751 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:39,751 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-26 15:54:39,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:39,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:39,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:39,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:39,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:39,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:39,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:39,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:39,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:39,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-26 15:54:39,754 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-26 15:54:39,754 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:39,754 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:39,754 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,754 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:39,759 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,759 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:39,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:39,759 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:39,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:39,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:39,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:39,759 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:39,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:39,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:39,761 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:39,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:39,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:39,763 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:39,763 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,763 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:39,763 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,763 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:39,763 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:39,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:39,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:39,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:39,763 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:39,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:39,763 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,763 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,763 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,763 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:39,763 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:39,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:39,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:39,863 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:39,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:39,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:39,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:39,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,869 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:39,870 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:39,870 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-26 15:54:39,870 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-26 15:54:39,870 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,870 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,871 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:39,871 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:39,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:39,872 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:39,872 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:39,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:39,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,873 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,873 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-26 15:54:39,873 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:39,873 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-26 15:54:39,873 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:39,873 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-26 15:54:39,873 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:39,873 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:39,873 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:39,873 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. started... 2023-11-26 15:54:39,873 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ea3a647b9f914561bb8e56dcb1bd89ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:40,286 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228927c55f3943e44f09c8d03f0f85fd7de to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228927c55f3943e44f09c8d03f0f85fd7de 2023-11-26 15:54:40,692 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/9934ed1a83c54b64902459527b2bc0ef 2023-11-26 15:54:40,697 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/9934ed1a83c54b64902459527b2bc0ef as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/9934ed1a83c54b64902459527b2bc0ef 2023-11-26 15:54:40,703 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/9934ed1a83c54b64902459527b2bc0ef, entries=1, sequenceid=21, filesize=5.0 K 2023-11-26 15:54:40,703 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ea3a647b9f914561bb8e56dcb1bd89ac in 830ms, sequenceid=21, compaction requested=true 2023-11-26 15:54:40,703 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:40,704 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:40,704 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:40,704 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:40,704 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:40,704 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-26 15:54:40,704 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-26 15:54:40,706 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:40,706 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:40,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:40,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:40,706 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,706 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:40,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:40,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:40,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-26 15:54:40,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51e0fcc1[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:40,708 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-26 15:54:40,708 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,710 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,710 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-26 15:54:40,710 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-26 15:54:40,710 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:40,710 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:40,710 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:40,712 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-26 15:54:40,712 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:40,712 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:40,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:40,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:40,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:40,712 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-26 15:54:40,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:40,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:40,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:40,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:40,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:40,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:40,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-26 15:54:40,715 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-26 15:54:40,715 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:40,715 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:40,715 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,715 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:40,716 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,716 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,716 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:40,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:40,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:40,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:40,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:40,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:40,717 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:40,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:40,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:40,718 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:40,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:40,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:40,721 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:40,721 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:40,721 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:40,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:40,721 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:40,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:40,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:40,721 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,721 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:40,721 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:40,721 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,721 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,721 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,721 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:40,721 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:40,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:40,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:40,821 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:40,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:40,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:40,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:40,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,828 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:40,828 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:40,828 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-26 15:54:40,828 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-26 15:54:40,829 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,829 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,831 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:40,831 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:40,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:40,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:40,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,831 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:40,831 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:40,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:40,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,832 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,832 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-26 15:54:40,832 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:40,832 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-26 15:54:40,832 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:40,832 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-26 15:54:40,835 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:40,835 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:40,835 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:40,835 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. started... 2023-11-26 15:54:40,835 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ea3a647b9f914561bb8e56dcb1bd89ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:41,252 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311175d075bf78428690ab470fcebeadc3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512311175d075bf78428690ab470fcebeadc3 2023-11-26 15:54:41,660 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/75a04807df544ff08da08d3b5cc546d3 2023-11-26 15:54:41,665 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/75a04807df544ff08da08d3b5cc546d3 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/75a04807df544ff08da08d3b5cc546d3 2023-11-26 15:54:41,670 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/75a04807df544ff08da08d3b5cc546d3, entries=1, sequenceid=25, filesize=5.0 K 2023-11-26 15:54:41,671 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ea3a647b9f914561bb8e56dcb1bd89ac in 836ms, sequenceid=25, compaction requested=true 2023-11-26 15:54:41,671 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:41,671 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:41,671 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:41,671 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:41,671 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:41,671 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-26 15:54:41,671 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-26 15:54:41,673 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,673 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:41,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:41,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:41,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:41,673 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,673 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:41,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:41,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:41,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:41,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:41,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-26 15:54:41,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b1abd51[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:41,675 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-26 15:54:41,675 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,676 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,677 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-26 15:54:41,677 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-26 15:54:41,677 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:41,677 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:41,677 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:41,678 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:41,678 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-26 15:54:41,678 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:41,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:41,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:41,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:41,678 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-26 15:54:41,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:41,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:41,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:41,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:41,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:41,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:41,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-26 15:54:41,681 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-26 15:54:41,681 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:41,681 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:41,681 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,681 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:41,684 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,684 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:41,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:41,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,684 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:41,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:41,684 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:41,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:41,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:41,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:41,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:41,686 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:41,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:41,688 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:41,688 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:41,688 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:41,689 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:41,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:41,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:41,689 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,689 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:41,689 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:41,689 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,689 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,689 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,689 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:41,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:41,689 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:41,789 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:41,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:41,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:41,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:41,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,797 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:41,797 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:41,797 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-26 15:54:41,797 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-26 15:54:41,797 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,797 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,799 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:41,799 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:41,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:41,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:41,799 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:41,799 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:41,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:41,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,800 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,800 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-26 15:54:41,800 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:41,800 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-26 15:54:41,801 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:41,801 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-26 15:54:41,801 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:41,801 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:41,801 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. started... 2023-11-26 15:54:41,801 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:41,801 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ea3a647b9f914561bb8e56dcb1bd89ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:42,214 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101220be10eb17d484095340177005ba722 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101220be10eb17d484095340177005ba722 2023-11-26 15:54:42,620 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/3d165da12f0e46e18454f34141c4bdcf 2023-11-26 15:54:42,624 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/3d165da12f0e46e18454f34141c4bdcf as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/3d165da12f0e46e18454f34141c4bdcf 2023-11-26 15:54:42,628 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/3d165da12f0e46e18454f34141c4bdcf, entries=1, sequenceid=29, filesize=5.0 K 2023-11-26 15:54:42,629 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ea3a647b9f914561bb8e56dcb1bd89ac in 828ms, sequenceid=29, compaction requested=true 2023-11-26 15:54:42,629 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:42,629 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:42,629 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:42,629 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:42,629 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,629 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-26 15:54:42,629 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-26 15:54:42,631 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,631 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:42,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:42,631 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,632 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:42,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:42,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:42,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:42,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-26 15:54:42,633 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65a3597c[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:42,633 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-26 15:54:42,633 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,640 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,640 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-26 15:54:42,640 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-26 15:54:42,641 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:42,641 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,641 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:42,642 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,642 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-26 15:54:42,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:42,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:42,642 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:42,642 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-26 15:54:42,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:42,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:42,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:42,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:42,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-26 15:54:42,644 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-26 15:54:42,644 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:42,644 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:42,644 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,644 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:42,646 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,646 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:42,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:42,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,646 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:42,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:42,646 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:42,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:42,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:42,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,648 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:42,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,650 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,650 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:42,650 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:42,650 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,650 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,650 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:42,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-26 15:54:42,650 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:42,650 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:42,650 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:42,650 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:42,651 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:42,651 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:42,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:42,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:42,751 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:42,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:42,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:42,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:42,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,758 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:42,758 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:42,758 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-26 15:54:42,758 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-26 15:54:42,758 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,758 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,762 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,762 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:42,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:42,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:42,762 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,762 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:42,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,763 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:42,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,763 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,763 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-26 15:54:42,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,764 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-26 15:54:42,764 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:42,764 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-26 15:54:42,764 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:42,764 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:42,764 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:42,764 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. started... 2023-11-26 15:54:42,764 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ea3a647b9f914561bb8e56dcb1bd89ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:42,778 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c62a65a18dd84c11abd528ba422f8ddd to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103c62a65a18dd84c11abd528ba422f8ddd 2023-11-26 15:54:42,787 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/1dc125d1cc044bd5adf3258d3cc53e95 2023-11-26 15:54:42,792 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/1dc125d1cc044bd5adf3258d3cc53e95 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/1dc125d1cc044bd5adf3258d3cc53e95 2023-11-26 15:54:42,796 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/1dc125d1cc044bd5adf3258d3cc53e95, entries=1, sequenceid=33, filesize=5.0 K 2023-11-26 15:54:42,797 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ea3a647b9f914561bb8e56dcb1bd89ac in 33ms, sequenceid=33, compaction requested=true 2023-11-26 15:54:42,797 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:42,797 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:42,797 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:42,797 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:42,797 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,797 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-26 15:54:42,797 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-26 15:54:42,799 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:42,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:42,800 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:42,800 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,800 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:42,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:42,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:42,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-26 15:54:42,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16893abf[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:42,802 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-26 15:54:42,802 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,811 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,811 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-26 15:54:42,811 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-26 15:54:42,811 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:42,811 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,811 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:42,813 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,813 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-26 15:54:42,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:42,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:42,813 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:42,813 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-26 15:54:42,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:42,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:42,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:42,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:42,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-26 15:54:42,816 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-26 15:54:42,816 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:42,816 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:42,816 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,816 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:42,817 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,817 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:42,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:42,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,817 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:42,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:42,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:42,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:42,818 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:42,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,819 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:42,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,821 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,821 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,821 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,821 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,821 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:42,821 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:42,821 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:42,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:42,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:42,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-26 15:54:42,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:42,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:42,821 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,822 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,822 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:42,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:42,822 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:42,822 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:42,922 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:42,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:42,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:42,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:42,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,928 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:42,929 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:42,929 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-26 15:54:42,929 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-26 15:54:42,929 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,929 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,930 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:42,930 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:42,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:42,931 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:42,931 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:42,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:42,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,932 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,932 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-26 15:54:42,932 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:42,932 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-26 15:54:42,932 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:42,932 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-26 15:54:42,932 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:42,932 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:42,932 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:42,932 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. started... 2023-11-26 15:54:42,932 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ea3a647b9f914561bb8e56dcb1bd89ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:43,345 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090703592ad7fb00488ea8133f4f151a3352 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015090703592ad7fb00488ea8133f4f151a3352 2023-11-26 15:54:43,751 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/3b44e90d1e6d46239fafcb67c76695bc 2023-11-26 15:54:43,756 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/3b44e90d1e6d46239fafcb67c76695bc as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/3b44e90d1e6d46239fafcb67c76695bc 2023-11-26 15:54:43,760 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/3b44e90d1e6d46239fafcb67c76695bc, entries=1, sequenceid=37, filesize=5.0 K 2023-11-26 15:54:43,761 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ea3a647b9f914561bb8e56dcb1bd89ac in 829ms, sequenceid=37, compaction requested=true 2023-11-26 15:54:43,762 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:43,762 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:43,762 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:43,762 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:43,762 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:43,762 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-26 15:54:43,762 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-26 15:54:43,764 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,764 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:43,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:43,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:43,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:43,765 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,765 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:43,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:43,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:43,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:43,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:43,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-26 15:54:43,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4059da5b[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:43,766 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-26 15:54:43,766 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,767 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,768 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-26 15:54:43,768 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-26 15:54:43,768 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:43,768 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:43,768 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:43,769 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-26 15:54:43,769 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:43,769 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:43,769 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-26 15:54:43,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:43,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:43,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:43,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:43,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:43,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:43,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:43,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:43,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:43,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-26 15:54:43,772 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-26 15:54:43,772 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:43,772 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:43,772 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,772 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:43,774 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,774 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,774 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:43,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:43,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:43,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:43,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:43,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:43,775 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:43,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:43,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,776 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:43,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:43,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:43,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:43,779 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:43,779 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:43,779 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:43,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:43,779 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:43,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:43,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:43,779 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:43,779 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,779 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:43,779 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,779 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,779 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,779 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:43,779 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:43,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-26 15:54:43,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:43,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:43,880 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:43,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:43,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:43,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:43,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,886 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:43,886 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:43,886 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-26 15:54:43,886 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-26 15:54:43,886 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,886 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,888 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:43,888 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:43,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:43,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:43,888 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:43,888 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:43,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:43,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,889 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,889 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-26 15:54:43,889 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:43,889 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-26 15:54:43,890 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:43,890 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-26 15:54:43,890 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:54:43,890 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:43,890 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:43,890 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. started... 2023-11-26 15:54:43,890 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ea3a647b9f914561bb8e56dcb1bd89ac 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:54:44,308 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120e3d36b09fad24bb5aed01bc90942a7b1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120e3d36b09fad24bb5aed01bc90942a7b1 2023-11-26 15:54:44,713 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/3ee7a582263e401c85118a99371d242c 2023-11-26 15:54:44,718 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/3ee7a582263e401c85118a99371d242c as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/3ee7a582263e401c85118a99371d242c 2023-11-26 15:54:44,722 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/3ee7a582263e401c85118a99371d242c, entries=1, sequenceid=41, filesize=5.0 K 2023-11-26 15:54:44,723 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ea3a647b9f914561bb8e56dcb1bd89ac in 833ms, sequenceid=41, compaction requested=true 2023-11-26 15:54:44,723 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:44,723 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:44,723 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:54:44,723 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:54:44,723 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:44,723 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-26 15:54:44,723 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-26 15:54:44,725 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:44,725 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:44,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:44,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:44,725 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,725 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:44,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:44,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:44,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:44,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:44,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-26 15:54:44,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e671734[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:44,726 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-26 15:54:44,726 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,728 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,728 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-26 15:54:44,728 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-26 15:54:44,728 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:44,728 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:44,728 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:44,731 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:44,731 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-26 15:54:44,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:44,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:44,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:44,731 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:44,731 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-26 15:54:44,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:44,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:44,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:44,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:44,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:44,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:44,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-26 15:54:44,733 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-26 15:54:44,734 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:44,734 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:44,734 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,734 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:44,738 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,738 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:44,738 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:44,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:44,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,738 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:44,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:44,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:44,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:44,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,740 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:44,742 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:44,742 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,742 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:44,742 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:44,742 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:44,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-26 15:54:44,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:44,742 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:44,742 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:44,742 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:44,743 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,743 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:44,743 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:44,743 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:44,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:44,843 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:44,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:44,845 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33415] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:44,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-26 15:54:44,847 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-26 15:54:44,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:54:44,848 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701014684848 2023-11-26 15:54:44,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-26 15:54:44,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-26 15:54:44,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-26 15:54:44,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] zookeeper.ReadOnlyZKClient(139): Connect 0x40732358 to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:54:44,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@782ec427, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:54:44,858 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:45,692 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039f2e844191c84d5f8f38b2a43ce209ea to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601039f2e844191c84d5f8f38b2a43ce209ea 2023-11-26 15:54:45,692 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-26 15:54:45,712 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:54:45,713 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:54:45,721 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-26 15:54:45,722 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44472, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-26 15:54:45,730 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d206f8247cb84261a29ddbda812bf6fc first=Optional[r3] last=Optional[r6] 2023-11-26 15:54:45,730 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d206f8247cb84261a29ddbda812bf6fc}] 2023-11-26 15:54:45,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d206f8247cb84261a29ddbda812bf6fc for inclusion in ea3a647b9f914561bb8e56dcb1bd89ac/family1 2023-11-26 15:54:45,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-26 15:54:45,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last= 2023-11-26 15:54:45,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:45,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/d206f8247cb84261a29ddbda812bf6fc to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__t3m3qb0lnur3vflp2k3ihjqs4t83hqjq1hk7kf20ar0ud1qi4br8aru6a337e9s1/family1/d206f8247cb84261a29ddbda812bf6fc 2023-11-26 15:54:45,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__t3m3qb0lnur3vflp2k3ihjqs4t83hqjq1hk7kf20ar0ud1qi4br8aru6a337e9s1/family1/d206f8247cb84261a29ddbda812bf6fc as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/da3d21323ac5499aa29ee2ada78ca292_SeqId_44_ 2023-11-26 15:54:45,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__t3m3qb0lnur3vflp2k3ihjqs4t83hqjq1hk7kf20ar0ud1qi4br8aru6a337e9s1/family1/d206f8247cb84261a29ddbda812bf6fc into ea3a647b9f914561bb8e56dcb1bd89ac/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/da3d21323ac5499aa29ee2ada78ca292_SeqId_44_ - updating store file list. 2023-11-26 15:54:45,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/da3d21323ac5499aa29ee2ada78ca292_SeqId_44_ into ea3a647b9f914561bb8e56dcb1bd89ac/family1 2023-11-26 15:54:45,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__t3m3qb0lnur3vflp2k3ihjqs4t83hqjq1hk7kf20ar0ud1qi4br8aru6a337e9s1/family1/d206f8247cb84261a29ddbda812bf6fc into ea3a647b9f914561bb8e56dcb1bd89ac/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/da3d21323ac5499aa29ee2ada78ca292_SeqId_44_) 2023-11-26 15:54:45,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__t3m3qb0lnur3vflp2k3ihjqs4t83hqjq1hk7kf20ar0ud1qi4br8aru6a337e9s1/family1/d206f8247cb84261a29ddbda812bf6fc 2023-11-26 15:54:45,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-26 15:54:45,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-26 15:54:45,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(1912): ea3a647b9f914561bb8e56dcb1bd89ac/family1 is initiating minor compaction 2023-11-26 15:54:45,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4306aa6e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:54:45,747 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ea3a647b9f914561bb8e56dcb1bd89ac/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:45,747 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/27b1621e837c450489224651c3b5cce4, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/18a6bb891fed40c995211a7cbdba19d1, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/314f66f533554c72a2129d14cf762f26, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/9934ed1a83c54b64902459527b2bc0ef, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/75a04807df544ff08da08d3b5cc546d3, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/3d165da12f0e46e18454f34141c4bdcf, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/1dc125d1cc044bd5adf3258d3cc53e95, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/3b44e90d1e6d46239fafcb67c76695bc, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/3ee7a582263e401c85118a99371d242c, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/da3d21323ac5499aa29ee2ada78ca292_SeqId_44_] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp, totalSize=50.3 K 2023-11-26 15:54:45,747 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 27b1621e837c450489224651c3b5cce4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-26 15:54:45,748 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 18a6bb891fed40c995211a7cbdba19d1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-26 15:54:45,748 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 314f66f533554c72a2129d14cf762f26, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-26 15:54:45,748 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 9934ed1a83c54b64902459527b2bc0ef, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-26 15:54:45,748 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 75a04807df544ff08da08d3b5cc546d3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-26 15:54:45,748 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 3d165da12f0e46e18454f34141c4bdcf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-26 15:54:45,748 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 1dc125d1cc044bd5adf3258d3cc53e95, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-26 15:54:45,748 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 3b44e90d1e6d46239fafcb67c76695bc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-26 15:54:45,748 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 3ee7a582263e401c85118a99371d242c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-26 15:54:45,748 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting da3d21323ac5499aa29ee2ada78ca292_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-26 15:54:45,754 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-26 15:54:45,755 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:45,756 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228927c55f3943e44f09c8d03f0f85fd7de to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228927c55f3943e44f09c8d03f0f85fd7de 2023-11-26 15:54:45,758 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512311175d075bf78428690ab470fcebeadc3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512311175d075bf78428690ab470fcebeadc3 2023-11-26 15:54:45,759 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101220be10eb17d484095340177005ba722 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101220be10eb17d484095340177005ba722 2023-11-26 15:54:45,760 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103c62a65a18dd84c11abd528ba422f8ddd to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103c62a65a18dd84c11abd528ba422f8ddd 2023-11-26 15:54:45,760 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-11-26 15:54:45,760 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-26 15:54:45,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:45,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:45,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:45,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:45,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:45,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:45,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:45,762 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:45,799 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] throttle.PressureAwareThroughputController(145): ea3a647b9f914561bb8e56dcb1bd89ac#family1#compaction#73 average throughput is 0.40 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:54:46,240 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120504fa002b9d13470ead6e4d840949f341 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120504fa002b9d13470ead6e4d840949f341 2023-11-26 15:54:46,240 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-26 15:54:46,265 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f2d5c74893604b18989d527e7b2bf419 first=Optional[r00] last=Optional[r2] 2023-11-26 15:54:46,266 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f2d5c74893604b18989d527e7b2bf419}] 2023-11-26 15:54:46,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f2d5c74893604b18989d527e7b2bf419 for inclusion in ea3a647b9f914561bb8e56dcb1bd89ac/family1 2023-11-26 15:54:46,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-26 15:54:46,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last= 2023-11-26 15:54:46,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:46,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f2d5c74893604b18989d527e7b2bf419 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2bn2c2t769qgjrh9cid3spdq2f9m9sop26qkpkn0cn4u35el3jucs2hj4lgcjs33/family1/f2d5c74893604b18989d527e7b2bf419 2023-11-26 15:54:46,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2bn2c2t769qgjrh9cid3spdq2f9m9sop26qkpkn0cn4u35el3jucs2hj4lgcjs33/family1/f2d5c74893604b18989d527e7b2bf419 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/aa8f3118c5c74cce80bdd06b6126f496_SeqId_46_ 2023-11-26 15:54:46,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2bn2c2t769qgjrh9cid3spdq2f9m9sop26qkpkn0cn4u35el3jucs2hj4lgcjs33/family1/f2d5c74893604b18989d527e7b2bf419 into ea3a647b9f914561bb8e56dcb1bd89ac/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/aa8f3118c5c74cce80bdd06b6126f496_SeqId_46_ - updating store file list. 2023-11-26 15:54:46,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/aa8f3118c5c74cce80bdd06b6126f496_SeqId_46_ into ea3a647b9f914561bb8e56dcb1bd89ac/family1 2023-11-26 15:54:46,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2bn2c2t769qgjrh9cid3spdq2f9m9sop26qkpkn0cn4u35el3jucs2hj4lgcjs33/family1/f2d5c74893604b18989d527e7b2bf419 into ea3a647b9f914561bb8e56dcb1bd89ac/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/aa8f3118c5c74cce80bdd06b6126f496_SeqId_46_) 2023-11-26 15:54:46,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__2bn2c2t769qgjrh9cid3spdq2f9m9sop26qkpkn0cn4u35el3jucs2hj4lgcjs33/family1/f2d5c74893604b18989d527e7b2bf419 2023-11-26 15:54:46,280 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-26 15:54:46,281 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:46,283 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130f2a593ddbe9d430887c175a25edc2130 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130f2a593ddbe9d430887c175a25edc2130 2023-11-26 15:54:46,284 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201fbaa4a2decda42bda902a66d4bee8b28 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201fbaa4a2decda42bda902a66d4bee8b28 2023-11-26 15:54:46,285 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120537805e828c8947218f50c94b79bb69e1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120537805e828c8947218f50c94b79bb69e1 2023-11-26 15:54:46,285 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-11-26 15:54:46,285 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-26 15:54:46,286 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:46,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-26 15:54:46,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:54:46,287 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-26 15:54:46,288 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.4410 sec 2023-11-26 15:54:46,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-26 15:54:46,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:46,624 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/ef2dd4d153ab4568be46e3758e576424 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/ef2dd4d153ab4568be46e3758e576424 2023-11-26 15:54:46,628 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in ea3a647b9f914561bb8e56dcb1bd89ac/family1 of ea3a647b9f914561bb8e56dcb1bd89ac into ef2dd4d153ab4568be46e3758e576424(size=6.8 K), total size for store is 388.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:54:46,628 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:46,628 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1701014085747; duration=0sec 2023-11-26 15:54:46,629 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:54:46,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/27b1621e837c450489224651c3b5cce4, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/18a6bb891fed40c995211a7cbdba19d1, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/314f66f533554c72a2129d14cf762f26, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/9934ed1a83c54b64902459527b2bc0ef, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/75a04807df544ff08da08d3b5cc546d3, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/3d165da12f0e46e18454f34141c4bdcf, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/1dc125d1cc044bd5adf3258d3cc53e95, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/3b44e90d1e6d46239fafcb67c76695bc, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/3ee7a582263e401c85118a99371d242c, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/da3d21323ac5499aa29ee2ada78ca292_SeqId_44_] to archive 2023-11-26 15:54:46,727 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:46,729 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/27b1621e837c450489224651c3b5cce4 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/27b1621e837c450489224651c3b5cce4 2023-11-26 15:54:46,730 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/18a6bb891fed40c995211a7cbdba19d1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/18a6bb891fed40c995211a7cbdba19d1 2023-11-26 15:54:46,731 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/314f66f533554c72a2129d14cf762f26 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/314f66f533554c72a2129d14cf762f26 2023-11-26 15:54:46,732 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/9934ed1a83c54b64902459527b2bc0ef to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/9934ed1a83c54b64902459527b2bc0ef 2023-11-26 15:54:46,733 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/75a04807df544ff08da08d3b5cc546d3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/75a04807df544ff08da08d3b5cc546d3 2023-11-26 15:54:46,734 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/3d165da12f0e46e18454f34141c4bdcf to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/3d165da12f0e46e18454f34141c4bdcf 2023-11-26 15:54:46,735 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/1dc125d1cc044bd5adf3258d3cc53e95 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/1dc125d1cc044bd5adf3258d3cc53e95 2023-11-26 15:54:46,736 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/3b44e90d1e6d46239fafcb67c76695bc to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/3b44e90d1e6d46239fafcb67c76695bc 2023-11-26 15:54:46,737 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/3ee7a582263e401c85118a99371d242c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/3ee7a582263e401c85118a99371d242c 2023-11-26 15:54:46,738 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/da3d21323ac5499aa29ee2ada78ca292_SeqId_44_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/da3d21323ac5499aa29ee2ada78ca292_SeqId_44_ 2023-11-26 15:54:46,784 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-26 15:54:46,785 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-26 15:54:46,785 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-26 15:54:46,787 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-26 15:54:46,790 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ea3a647b9f914561bb8e56dcb1bd89ac, REOPEN/MOVE}] 2023-11-26 15:54:46,790 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ea3a647b9f914561bb8e56dcb1bd89ac, REOPEN/MOVE 2023-11-26 15:54:46,791 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=ea3a647b9f914561bb8e56dcb1bd89ac, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:46,791 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701014086791"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014086791"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014086791"}]},"ts":"1701014086791"} 2023-11-26 15:54:46,792 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure ea3a647b9f914561bb8e56dcb1bd89ac, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:54:46,943 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:46,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:46,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ea3a647b9f914561bb8e56dcb1bd89ac, disabling compactions & flushes 2023-11-26 15:54:46,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:46,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:46,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. after waiting 0 ms 2023-11-26 15:54:46,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:46,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-26 15:54:46,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:46,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:46,952 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: ea3a647b9f914561bb8e56dcb1bd89ac to self. 2023-11-26 15:54:46,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:46,953 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=ea3a647b9f914561bb8e56dcb1bd89ac, regionState=CLOSED 2023-11-26 15:54:46,953 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701014086953"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014086953"}]},"ts":"1701014086953"} 2023-11-26 15:54:46,956 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=62, resume processing ppid=61 2023-11-26 15:54:46,956 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure ea3a647b9f914561bb8e56dcb1bd89ac, server=jenkins-hbase4.apache.org,41861,1701014000937 in 162 msec 2023-11-26 15:54:46,956 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ea3a647b9f914561bb8e56dcb1bd89ac, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=true 2023-11-26 15:54:47,107 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=ea3a647b9f914561bb8e56dcb1bd89ac, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:47,107 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701014087106"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014087106"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014087106"}]},"ts":"1701014087106"} 2023-11-26 15:54:47,108 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure ea3a647b9f914561bb8e56dcb1bd89ac, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:54:47,260 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:47,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:47,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ea3a647b9f914561bb8e56dcb1bd89ac, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac.', STARTKEY => '', ENDKEY => ''} 2023-11-26 15:54:47,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:47,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:47,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:47,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:47,264 INFO [StoreOpener-ea3a647b9f914561bb8e56dcb1bd89ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:47,265 DEBUG [StoreOpener-ea3a647b9f914561bb8e56dcb1bd89ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1 2023-11-26 15:54:47,265 DEBUG [StoreOpener-ea3a647b9f914561bb8e56dcb1bd89ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1 2023-11-26 15:54:47,266 INFO [StoreOpener-ea3a647b9f914561bb8e56dcb1bd89ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea3a647b9f914561bb8e56dcb1bd89ac columnFamilyName family1 2023-11-26 15:54:47,270 DEBUG [StoreOpener-ea3a647b9f914561bb8e56dcb1bd89ac-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/aa8f3118c5c74cce80bdd06b6126f496_SeqId_46_ 2023-11-26 15:54:47,275 DEBUG [StoreOpener-ea3a647b9f914561bb8e56dcb1bd89ac-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/e31d0b4964614a8a8d637bd4d73516ac 2023-11-26 15:54:47,278 DEBUG [StoreOpener-ea3a647b9f914561bb8e56dcb1bd89ac-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/ef2dd4d153ab4568be46e3758e576424 2023-11-26 15:54:47,278 INFO [StoreOpener-ea3a647b9f914561bb8e56dcb1bd89ac-1] regionserver.HStore(310): Store=ea3a647b9f914561bb8e56dcb1bd89ac/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:54:47,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:47,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:47,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:47,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ea3a647b9f914561bb8e56dcb1bd89ac; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66847579, jitterRate=-0.003893449902534485}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-26 15:54:47,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:47,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac., pid=63, masterSystemTime=1701014087260 2023-11-26 15:54:47,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:54:47,286 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-26 15:54:47,287 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-26 15:54:47,287 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1912): ea3a647b9f914561bb8e56dcb1bd89ac/family1 is initiating minor compaction (all files) 2023-11-26 15:54:47,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:47,287 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ea3a647b9f914561bb8e56dcb1bd89ac/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:47,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:47,288 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/e31d0b4964614a8a8d637bd4d73516ac, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/ef2dd4d153ab4568be46e3758e576424, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/aa8f3118c5c74cce80bdd06b6126f496_SeqId_46_] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp, totalSize=388.1 K 2023-11-26 15:54:47,288 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=ea3a647b9f914561bb8e56dcb1bd89ac, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:47,288 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting e31d0b4964614a8a8d637bd4d73516ac, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823935 2023-11-26 15:54:47,288 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701014087288"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014087288"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014087288"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014087288"}]},"ts":"1701014087288"} 2023-11-26 15:54:47,288 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting ef2dd4d153ab4568be46e3758e576424, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223935 2023-11-26 15:54:47,289 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting aa8f3118c5c74cce80bdd06b6126f496_SeqId_46_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878823935 2023-11-26 15:54:47,291 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=63, resume processing ppid=61 2023-11-26 15:54:47,291 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure ea3a647b9f914561bb8e56dcb1bd89ac, server=jenkins-hbase4.apache.org,41861,1701014000937 in 181 msec 2023-11-26 15:54:47,292 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=61, resume processing ppid=60 2023-11-26 15:54:47,292 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ea3a647b9f914561bb8e56dcb1bd89ac, REOPEN/MOVE in 502 msec 2023-11-26 15:54:47,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=60, resume processing ppid=59 2023-11-26 15:54:47,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 506 msec 2023-11-26 15:54:47,297 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 921 msec 2023-11-26 15:54:47,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-11-26 15:54:47,299 INFO [Listener at localhost/43645] compactions.TestMobCompactor(278): alter status finished 2023-11-26 15:54:47,300 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33415] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:47,302 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-26 15:54:47,306 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-26 15:54:47,306 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:54:47,306 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701014687306 2023-11-26 15:54:47,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-26 15:54:47,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-26 15:54:47,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-26 15:54:47,308 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] throttle.PressureAwareThroughputController(145): ea3a647b9f914561bb8e56dcb1bd89ac#family1#compaction#74 average throughput is 16.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:54:47,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] zookeeper.ReadOnlyZKClient(139): Connect 0x6bde0295 to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:54:47,317 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f5d1ddd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:54:47,317 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:47,317 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:47,317 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:47,317 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:47,317 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:48,139 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112883c94e5fe87d4d3cad6352dbeb19d8a9 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112883c94e5fe87d4d3cad6352dbeb19d8a9 2023-11-26 15:54:48,140 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-26 15:54:48,153 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:54:48,154 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:54:48,159 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-26 15:54:48,161 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44486, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-26 15:54:48,170 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/71f22624b88c4ef6948622dadd3d096b first=Optional[r05] last=Optional[r8] 2023-11-26 15:54:48,170 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=50 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/71f22624b88c4ef6948622dadd3d096b}] 2023-11-26 15:54:48,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/71f22624b88c4ef6948622dadd3d096b for inclusion in ea3a647b9f914561bb8e56dcb1bd89ac/family1 2023-11-26 15:54:48,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-26 15:54:48,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last= 2023-11-26 15:54:48,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:48,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/71f22624b88c4ef6948622dadd3d096b to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9i9edlampc601j143vld6rrmclc7lijpjl22dbng7c3f3bs26tv3qusop6eqsi7/family1/71f22624b88c4ef6948622dadd3d096b 2023-11-26 15:54:48,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9i9edlampc601j143vld6rrmclc7lijpjl22dbng7c3f3bs26tv3qusop6eqsi7/family1/71f22624b88c4ef6948622dadd3d096b as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/117808f2ae6a4b26bc16e2d9dc5d574e_SeqId_52_ 2023-11-26 15:54:48,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9i9edlampc601j143vld6rrmclc7lijpjl22dbng7c3f3bs26tv3qusop6eqsi7/family1/71f22624b88c4ef6948622dadd3d096b into ea3a647b9f914561bb8e56dcb1bd89ac/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/117808f2ae6a4b26bc16e2d9dc5d574e_SeqId_52_ - updating store file list. 2023-11-26 15:54:48,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/117808f2ae6a4b26bc16e2d9dc5d574e_SeqId_52_ into ea3a647b9f914561bb8e56dcb1bd89ac/family1 2023-11-26 15:54:48,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9i9edlampc601j143vld6rrmclc7lijpjl22dbng7c3f3bs26tv3qusop6eqsi7/family1/71f22624b88c4ef6948622dadd3d096b into ea3a647b9f914561bb8e56dcb1bd89ac/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/117808f2ae6a4b26bc16e2d9dc5d574e_SeqId_52_) 2023-11-26 15:54:48,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__9i9edlampc601j143vld6rrmclc7lijpjl22dbng7c3f3bs26tv3qusop6eqsi7/family1/71f22624b88c4ef6948622dadd3d096b 2023-11-26 15:54:48,185 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-26 15:54:48,185 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:48,187 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120e3d36b09fad24bb5aed01bc90942a7b1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120e3d36b09fad24bb5aed01bc90942a7b1 2023-11-26 15:54:48,188 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112823a75cb8620649f085d21c86c32ffbc1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112823a75cb8620649f085d21c86c32ffbc1 2023-11-26 15:54:48,188 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-11-26 15:54:48,188 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-26 15:54:48,188 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:48,188 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:48,188 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:48,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-26 15:54:48,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:54:48,189 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-26 15:54:48,190 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 888 msec 2023-11-26 15:54:48,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-11-26 15:54:48,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:48,529 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/.tmp/family1/970d44af5244476cbf58514ce702da05 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/970d44af5244476cbf58514ce702da05 2023-11-26 15:54:48,534 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ea3a647b9f914561bb8e56dcb1bd89ac/family1 of ea3a647b9f914561bb8e56dcb1bd89ac into 970d44af5244476cbf58514ce702da05(size=192.0 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-26 15:54:48,534 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:48,534 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac., storeName=ea3a647b9f914561bb8e56dcb1bd89ac/family1, priority=13, startTime=1701014087285; duration=1sec 2023-11-26 15:54:48,534 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:54:48,626 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/e31d0b4964614a8a8d637bd4d73516ac, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/ef2dd4d153ab4568be46e3758e576424, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/aa8f3118c5c74cce80bdd06b6126f496_SeqId_46_] to archive 2023-11-26 15:54:48,627 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:48,628 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/e31d0b4964614a8a8d637bd4d73516ac to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/e31d0b4964614a8a8d637bd4d73516ac 2023-11-26 15:54:48,630 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/ef2dd4d153ab4568be46e3758e576424 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/ef2dd4d153ab4568be46e3758e576424 2023-11-26 15:54:48,631 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/aa8f3118c5c74cce80bdd06b6126f496_SeqId_46_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/aa8f3118c5c74cce80bdd06b6126f496_SeqId_46_ 2023-11-26 15:54:48,650 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-26 15:54:48,650 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-26 15:54:48,650 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-26 15:54:48,652 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-26 15:54:48,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ea3a647b9f914561bb8e56dcb1bd89ac, REOPEN/MOVE}] 2023-11-26 15:54:48,655 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ea3a647b9f914561bb8e56dcb1bd89ac, REOPEN/MOVE 2023-11-26 15:54:48,656 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ea3a647b9f914561bb8e56dcb1bd89ac, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:48,656 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701014088656"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014088656"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014088656"}]},"ts":"1701014088656"} 2023-11-26 15:54:48,657 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure ea3a647b9f914561bb8e56dcb1bd89ac, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:54:48,808 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:48,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:48,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ea3a647b9f914561bb8e56dcb1bd89ac, disabling compactions & flushes 2023-11-26 15:54:48,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:48,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:48,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. after waiting 0 ms 2023-11-26 15:54:48,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:48,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-11-26 15:54:48,816 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:48,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:48,816 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: ea3a647b9f914561bb8e56dcb1bd89ac to self. 2023-11-26 15:54:48,818 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:48,818 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ea3a647b9f914561bb8e56dcb1bd89ac, regionState=CLOSED 2023-11-26 15:54:48,818 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701014088818"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014088818"}]},"ts":"1701014088818"} 2023-11-26 15:54:48,820 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=68, resume processing ppid=67 2023-11-26 15:54:48,820 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure ea3a647b9f914561bb8e56dcb1bd89ac, server=jenkins-hbase4.apache.org,41861,1701014000937 in 162 msec 2023-11-26 15:54:48,821 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ea3a647b9f914561bb8e56dcb1bd89ac, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=true 2023-11-26 15:54:48,971 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ea3a647b9f914561bb8e56dcb1bd89ac, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:48,972 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701014088971"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014088971"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014088971"}]},"ts":"1701014088971"} 2023-11-26 15:54:48,974 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure ea3a647b9f914561bb8e56dcb1bd89ac, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:54:49,125 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:49,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:49,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ea3a647b9f914561bb8e56dcb1bd89ac, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac.', STARTKEY => '', ENDKEY => ''} 2023-11-26 15:54:49,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:49,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:49,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:49,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:49,130 INFO [StoreOpener-ea3a647b9f914561bb8e56dcb1bd89ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:49,131 DEBUG [StoreOpener-ea3a647b9f914561bb8e56dcb1bd89ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1 2023-11-26 15:54:49,131 DEBUG [StoreOpener-ea3a647b9f914561bb8e56dcb1bd89ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1 2023-11-26 15:54:49,131 INFO [StoreOpener-ea3a647b9f914561bb8e56dcb1bd89ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea3a647b9f914561bb8e56dcb1bd89ac columnFamilyName family1 2023-11-26 15:54:49,136 DEBUG [StoreOpener-ea3a647b9f914561bb8e56dcb1bd89ac-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/117808f2ae6a4b26bc16e2d9dc5d574e_SeqId_52_ 2023-11-26 15:54:49,140 DEBUG [StoreOpener-ea3a647b9f914561bb8e56dcb1bd89ac-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/family1/970d44af5244476cbf58514ce702da05 2023-11-26 15:54:49,140 INFO [StoreOpener-ea3a647b9f914561bb8e56dcb1bd89ac-1] regionserver.HStore(310): Store=ea3a647b9f914561bb8e56dcb1bd89ac/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:54:49,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:49,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:49,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:54:49,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ea3a647b9f914561bb8e56dcb1bd89ac; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73560909, jitterRate=0.0961429625749588}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-26 15:54:49,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:54:49,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac., pid=69, masterSystemTime=1701014089125 2023-11-26 15:54:49,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:49,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:54:49,148 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ea3a647b9f914561bb8e56dcb1bd89ac, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:49,148 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701014089148"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014089148"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014089148"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014089148"}]},"ts":"1701014089148"} 2023-11-26 15:54:49,150 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=69, resume processing ppid=67 2023-11-26 15:54:49,151 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure ea3a647b9f914561bb8e56dcb1bd89ac, server=jenkins-hbase4.apache.org,41861,1701014000937 in 176 msec 2023-11-26 15:54:49,152 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=67, resume processing ppid=66 2023-11-26 15:54:49,152 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ea3a647b9f914561bb8e56dcb1bd89ac, REOPEN/MOVE in 496 msec 2023-11-26 15:54:49,153 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=66, resume processing ppid=65 2023-11-26 15:54:49,153 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 500 msec 2023-11-26 15:54:49,155 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 914 msec 2023-11-26 15:54:49,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-11-26 15:54:49,156 INFO [Listener at localhost/43645] compactions.TestMobCompactor(278): alter status finished 2023-11-26 15:54:49,157 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33415] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-26 15:54:49,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-26 15:54:49,159 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-26 15:54:49,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:54:49,160 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701014689160 2023-11-26 15:54:49,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-26 15:54:49,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-26 15:54:49,161 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-26 15:54:49,162 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] zookeeper.ReadOnlyZKClient(139): Connect 0x06b23de9 to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:54:49,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f2e966d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:54:49,167 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:49,167 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:49,167 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:49,167 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:49,167 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:49,167 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:49,167 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:49,167 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-26 15:54:49,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-26 15:54:49,168 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:54:49,168 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-26 15:54:49,169 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 10 msec 2023-11-26 15:54:49,230 INFO [Listener at localhost/43645] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=244 (was 254), OpenFileDescriptor=641 (was 665), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=173 (was 194), ProcessCount=171 (was 171), AvailableMemoryMB=8333 (was 8393) 2023-11-26 15:54:49,242 INFO [Listener at localhost/43645] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=244, OpenFileDescriptor=641, MaxFileDescriptor=60000, SystemLoadAverage=173, ProcessCount=171, AvailableMemoryMB=8332 2023-11-26 15:54:49,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-26 15:54:49,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-11-26 15:54:49,247 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-26 15:54:49,247 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-11-26 15:54:49,247 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-26 15:54:49,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-26 15:54:49,249 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3 2023-11-26 15:54:49,249 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3 empty. 2023-11-26 15:54:49,250 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3 2023-11-26 15:54:49,250 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-26 15:54:49,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-26 15:54:49,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-26 15:54:49,657 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-11-26 15:54:49,658 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 85d1c52a56d6f318e73d9af5da74f3c3, NAME => 'testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:54:49,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-26 15:54:50,064 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:50,064 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 85d1c52a56d6f318e73d9af5da74f3c3, disabling compactions & flushes 2023-11-26 15:54:50,064 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3. 2023-11-26 15:54:50,064 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3. 2023-11-26 15:54:50,064 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3. after waiting 0 ms 2023-11-26 15:54:50,064 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3. 2023-11-26 15:54:50,064 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3. 2023-11-26 15:54:50,065 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 85d1c52a56d6f318e73d9af5da74f3c3: 2023-11-26 15:54:50,067 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-26 15:54:50,068 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1701014090067"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014090067"}]},"ts":"1701014090067"} 2023-11-26 15:54:50,069 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-26 15:54:50,069 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-26 15:54:50,069 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014090069"}]},"ts":"1701014090069"} 2023-11-26 15:54:50,070 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-11-26 15:54:50,074 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=85d1c52a56d6f318e73d9af5da74f3c3, ASSIGN}] 2023-11-26 15:54:50,075 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=85d1c52a56d6f318e73d9af5da74f3c3, ASSIGN 2023-11-26 15:54:50,076 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=85d1c52a56d6f318e73d9af5da74f3c3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:54:50,227 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=85d1c52a56d6f318e73d9af5da74f3c3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:50,227 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1701014090226"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014090226"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014090226"}]},"ts":"1701014090226"} 2023-11-26 15:54:50,228 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 85d1c52a56d6f318e73d9af5da74f3c3, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:54:50,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-26 15:54:50,380 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:50,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3. 2023-11-26 15:54:50,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 85d1c52a56d6f318e73d9af5da74f3c3, NAME => 'testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3.', STARTKEY => '', ENDKEY => ''} 2023-11-26 15:54:50,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-11-26 15:54:50,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-11-26 15:54:50,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 85d1c52a56d6f318e73d9af5da74f3c3 2023-11-26 15:54:50,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:50,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 85d1c52a56d6f318e73d9af5da74f3c3 2023-11-26 15:54:50,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 85d1c52a56d6f318e73d9af5da74f3c3 2023-11-26 15:54:50,386 INFO [StoreOpener-85d1c52a56d6f318e73d9af5da74f3c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 85d1c52a56d6f318e73d9af5da74f3c3 2023-11-26 15:54:50,387 DEBUG [StoreOpener-85d1c52a56d6f318e73d9af5da74f3c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1 2023-11-26 15:54:50,387 DEBUG [StoreOpener-85d1c52a56d6f318e73d9af5da74f3c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1 2023-11-26 15:54:50,387 INFO [StoreOpener-85d1c52a56d6f318e73d9af5da74f3c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85d1c52a56d6f318e73d9af5da74f3c3 columnFamilyName f1 2023-11-26 15:54:50,389 INFO [StoreOpener-85d1c52a56d6f318e73d9af5da74f3c3-1] regionserver.HStore(310): Store=85d1c52a56d6f318e73d9af5da74f3c3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:54:50,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3 2023-11-26 15:54:50,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3 2023-11-26 15:54:50,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 85d1c52a56d6f318e73d9af5da74f3c3 2023-11-26 15:54:50,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:54:50,394 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 85d1c52a56d6f318e73d9af5da74f3c3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71487329, jitterRate=0.06524421274662018}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-26 15:54:50,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 85d1c52a56d6f318e73d9af5da74f3c3: 2023-11-26 15:54:50,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3., pid=73, masterSystemTime=1701014090380 2023-11-26 15:54:50,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3. 2023-11-26 15:54:50,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3. 2023-11-26 15:54:50,396 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=85d1c52a56d6f318e73d9af5da74f3c3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:50,396 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1701014090396"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014090396"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014090396"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014090396"}]},"ts":"1701014090396"} 2023-11-26 15:54:50,398 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=73, resume processing ppid=72 2023-11-26 15:54:50,398 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 85d1c52a56d6f318e73d9af5da74f3c3, server=jenkins-hbase4.apache.org,41861,1701014000937 in 169 msec 2023-11-26 15:54:50,400 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=72, resume processing ppid=71 2023-11-26 15:54:50,400 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=85d1c52a56d6f318e73d9af5da74f3c3, ASSIGN in 324 msec 2023-11-26 15:54:50,400 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-26 15:54:50,400 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014090400"}]},"ts":"1701014090400"} 2023-11-26 15:54:50,401 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-11-26 15:54:50,403 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-26 15:54:50,404 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1580 sec 2023-11-26 15:54:51,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-26 15:54:51,352 INFO [Listener at localhost/43645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-11-26 15:54:51,353 DEBUG [Listener at localhost/43645] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-11-26 15:54:51,354 INFO [Listener at localhost/43645] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-26 15:54:51,358 INFO [Listener at localhost/43645] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-11-26 15:54:51,358 INFO [Listener at localhost/43645] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-26 15:54:51,358 INFO [Listener at localhost/43645] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-11-26 15:54:51,362 INFO [Listener at localhost/43645] regionserver.HRegion(2745): Flushing 85d1c52a56d6f318e73d9af5da74f3c3 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-26 15:54:51,774 INFO [Listener at localhost/43645] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112609c65cd30ecd4026ad04dbe37062dee1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023112609c65cd30ecd4026ad04dbe37062dee1 2023-11-26 15:54:51,946 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06b23de9 to 127.0.0.1:58210 2023-11-26 15:54:51,946 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-11-26 15:54:51,946 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:54:51,946 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-26 15:54:51,946 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40732358 to 127.0.0.1:58210 2023-11-26 15:54:51,946 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:54:51,946 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-26 15:54:51,947 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bde0295 to 127.0.0.1:58210 2023-11-26 15:54:51,947 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:54:52,347 INFO [Listener at localhost/43645] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/.tmp/f1/be750eaa22764324ae10bc8bf1b69e33 2023-11-26 15:54:52,353 DEBUG [Listener at localhost/43645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/.tmp/f1/be750eaa22764324ae10bc8bf1b69e33 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33 2023-11-26 15:54:52,356 INFO [Listener at localhost/43645] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33, entries=1, sequenceid=5, filesize=4.9 K 2023-11-26 15:54:52,357 INFO [Listener at localhost/43645] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 85d1c52a56d6f318e73d9af5da74f3c3 in 995ms, sequenceid=5, compaction requested=false 2023-11-26 15:54:52,357 DEBUG [Listener at localhost/43645] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-11-26 15:54:52,358 DEBUG [Listener at localhost/43645] regionserver.HRegion(2446): Flush status journal for 85d1c52a56d6f318e73d9af5da74f3c3: 2023-11-26 15:54:52,361 INFO [Listener at localhost/43645] regionserver.HRegion(2745): Flushing 85d1c52a56d6f318e73d9af5da74f3c3 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-26 15:54:52,492 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-26 15:54:52,772 INFO [Listener at localhost/43645] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112643b036bb922a4f939c0ad85d8af7915e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023112643b036bb922a4f939c0ad85d8af7915e 2023-11-26 15:54:53,178 INFO [Listener at localhost/43645] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/.tmp/f1/806a2ce8d99647899bfb30d38f87843b 2023-11-26 15:54:53,182 DEBUG [Listener at localhost/43645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/.tmp/f1/806a2ce8d99647899bfb30d38f87843b as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b 2023-11-26 15:54:53,186 INFO [Listener at localhost/43645] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b, entries=1, sequenceid=9, filesize=4.9 K 2023-11-26 15:54:53,187 INFO [Listener at localhost/43645] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 85d1c52a56d6f318e73d9af5da74f3c3 in 826ms, sequenceid=9, compaction requested=false 2023-11-26 15:54:53,187 DEBUG [Listener at localhost/43645] regionserver.HRegion(2446): Flush status journal for 85d1c52a56d6f318e73d9af5da74f3c3: 2023-11-26 15:54:53,188 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=33415] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-11-26 15:54:53,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-26 15:54:53,190 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-26 15:54:53,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:54:53,190 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701014693190 2023-11-26 15:54:53,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-26 15:54:53,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-11-26 15:54:53,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-11-26 15:54:53,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] zookeeper.ReadOnlyZKClient(139): Connect 0x3d5cf3ea to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:54:53,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@760a97d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:54:53,196 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231126 for table='testGetAfterCompaction' and column='f1' 2023-11-26 15:54:53,240 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,240 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,290 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,291 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,341 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,342 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,392 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,392 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,443 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,443 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,494 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,494 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,545 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,545 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,596 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,596 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,621 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112621ebf207a4814cd681b6bd96f668bfe9 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023112621ebf207a4814cd681b6bd96f668bfe9 2023-11-26 15:54:53,622 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231126 table='testGetAfterCompaction' column='f1' 2023-11-26 15:54:53,641 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:54:53,642 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:54:53,647 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,647 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,649 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-26 15:54:53,650 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-26 15:54:53,658 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231126/f1/73b8700b52e94025a35136f3603daaed first=Optional[r1] last=Optional[r2] 2023-11-26 15:54:53,659 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row with hfile group [{f1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231126/f1/73b8700b52e94025a35136f3603daaed}] 2023-11-26 15:54:53,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231126/f1/73b8700b52e94025a35136f3603daaed for inclusion in 85d1c52a56d6f318e73d9af5da74f3c3/f1 2023-11-26 15:54:53,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-26 15:54:53,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last= 2023-11-26 15:54:53,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for 85d1c52a56d6f318e73d9af5da74f3c3: 2023-11-26 15:54:53,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231126/f1/73b8700b52e94025a35136f3603daaed to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testGetAfterCompaction__qka8vv2c51nal1g9k8jt74kc60o8mhk6uvnnu99s372kukrfqnhhtdvjolq2lf2m/f1/73b8700b52e94025a35136f3603daaed 2023-11-26 15:54:53,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testGetAfterCompaction__qka8vv2c51nal1g9k8jt74kc60o8mhk6uvnnu99s372kukrfqnhhtdvjolq2lf2m/f1/73b8700b52e94025a35136f3603daaed as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_ 2023-11-26 15:54:53,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testGetAfterCompaction__qka8vv2c51nal1g9k8jt74kc60o8mhk6uvnnu99s372kukrfqnhhtdvjolq2lf2m/f1/73b8700b52e94025a35136f3603daaed into 85d1c52a56d6f318e73d9af5da74f3c3/f1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_ - updating store file list. 2023-11-26 15:54:53,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_ into 85d1c52a56d6f318e73d9af5da74f3c3/f1 2023-11-26 15:54:53,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testGetAfterCompaction__qka8vv2c51nal1g9k8jt74kc60o8mhk6uvnnu99s372kukrfqnhhtdvjolq2lf2m/f1/73b8700b52e94025a35136f3603daaed into 85d1c52a56d6f318e73d9af5da74f3c3/f1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_) 2023-11-26 15:54:53,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testGetAfterCompaction__qka8vv2c51nal1g9k8jt74kc60o8mhk6uvnnu99s372kukrfqnhhtdvjolq2lf2m/f1/73b8700b52e94025a35136f3603daaed 2023-11-26 15:54:53,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(1912): 85d1c52a56d6f318e73d9af5da74f3c3/f1 is initiating minor compaction 2023-11-26 15:54:53,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6f06fe1a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:54:53,672 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 85d1c52a56d6f318e73d9af5da74f3c3/f1 in testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3. 2023-11-26 15:54:53,672 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/.tmp, totalSize=10.0 K 2023-11-26 15:54:53,672 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 806a2ce8d99647899bfb30d38f87843b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-26 15:54:53,672 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 01b7474a90eb45059be0ef913e926115_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-26 15:54:53,674 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231126 table='testGetAfterCompaction' column='f1' 2023-11-26 15:54:53,675 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:53,676 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023112609c65cd30ecd4026ad04dbe37062dee1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023112609c65cd30ecd4026ad04dbe37062dee1 2023-11-26 15:54:53,677 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023112643b036bb922a4f939c0ad85d8af7915e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023112643b036bb922a4f939c0ad85d8af7915e 2023-11-26 15:54:53,677 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-11-26 15:54:53,677 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231126' 2023-11-26 15:54:53,678 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231126 for table='testGetAfterCompaction' and column='f1' 2023-11-26 15:54:53,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-11-26 15:54:53,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:54:53,679 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-26 15:54:53,681 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 490 msec 2023-11-26 15:54:53,681 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] throttle.PressureAwareThroughputController(145): 85d1c52a56d6f318e73d9af5da74f3c3#f1#compaction#77 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:54:53,697 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701014093617; access_time=1701014093208; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-26 15:54:53,697 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,697 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,701 DEBUG [Listener at localhost/43645] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-26 15:54:53,705 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-26 15:54:53,705 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41861] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3. 2023-11-26 15:54:53,706 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41861] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-11-26 15:54:53,706 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41861] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-26 15:54:53,706 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41861] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-26 15:54:53,706 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=41861] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3. because compaction request was cancelled 2023-11-26 15:54:53,758 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701014093617; access_time=1701014093208; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-26 15:54:53,758 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,758 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,809 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701014093617; access_time=1701014093208; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-26 15:54:53,809 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,809 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,860 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701014093617; access_time=1701014093208; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-26 15:54:53,860 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,860 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,910 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701014093617; access_time=1701014093208; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-26 15:54:53,911 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,911 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,961 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701014093617; access_time=1701014093208; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-26 15:54:53,962 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:53,962 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,012 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701014093617; access_time=1701014093208; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-26 15:54:54,013 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,013 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,063 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701014093617; access_time=1701014093208; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-26 15:54:54,063 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,063 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,114 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701014093617; access_time=1701014093208; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-26 15:54:54,114 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,114 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,165 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701014093617; access_time=1701014093208; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-26 15:54:54,165 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,165 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,216 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701014093617; access_time=1701014093208; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-26 15:54:54,216 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,216 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,267 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701014093617; access_time=1701014093208; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-26 15:54:54,268 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,268 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,318 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701014093617; access_time=1701014093208; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-26 15:54:54,319 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,319 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,369 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701014093617; access_time=1701014093208; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-26 15:54:54,370 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,370 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,421 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701014093617; access_time=1701014093208; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-26 15:54:54,421 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,421 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,471 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701014093617; access_time=1701014093208; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-26 15:54:54,472 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,472 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,496 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/.tmp/f1/48b791883b2c4a0491905fbbf9282dbf as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/48b791883b2c4a0491905fbbf9282dbf 2023-11-26 15:54:54,500 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 85d1c52a56d6f318e73d9af5da74f3c3/f1 of 85d1c52a56d6f318e73d9af5da74f3c3 into 48b791883b2c4a0491905fbbf9282dbf(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:54:54,500 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 85d1c52a56d6f318e73d9af5da74f3c3: 2023-11-26 15:54:54,500 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1701014093672; duration=0sec 2023-11-26 15:54:54,500 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:54:54,522 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701014093617; access_time=1701014093208; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-26 15:54:54,522 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/48b791883b2c4a0491905fbbf9282dbf; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1701014094491; access_time=1701014093678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,522 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014093177; access_time=1701014092362; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,522 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,546 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_] to archive 2023-11-26 15:54:54,547 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:54:54,550 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/806a2ce8d99647899bfb30d38f87843b 2023-11-26 15:54:54,551 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/01b7474a90eb45059be0ef913e926115_SeqId_12_ 2023-11-26 15:54:54,573 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/48b791883b2c4a0491905fbbf9282dbf; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1701014094491; access_time=1701014093678; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,573 INFO [Listener at localhost/43645] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701014092346; access_time=1701014091365; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-26 15:54:54,689 INFO [Listener at localhost/43645] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-11-26 15:54:54,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-11-26 15:54:54,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-11-26 15:54:54,703 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014094703"}]},"ts":"1701014094703"} 2023-11-26 15:54:54,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-26 15:54:54,704 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-11-26 15:54:54,707 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-11-26 15:54:54,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=85d1c52a56d6f318e73d9af5da74f3c3, UNASSIGN}] 2023-11-26 15:54:54,709 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=85d1c52a56d6f318e73d9af5da74f3c3, UNASSIGN 2023-11-26 15:54:54,710 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=85d1c52a56d6f318e73d9af5da74f3c3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:54,710 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1701014094710"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014094710"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014094710"}]},"ts":"1701014094710"} 2023-11-26 15:54:54,711 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 85d1c52a56d6f318e73d9af5da74f3c3, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:54:54,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-26 15:54:54,863 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:54,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 85d1c52a56d6f318e73d9af5da74f3c3 2023-11-26 15:54:54,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 85d1c52a56d6f318e73d9af5da74f3c3, disabling compactions & flushes 2023-11-26 15:54:54,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3. 2023-11-26 15:54:54,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3. 2023-11-26 15:54:54,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3. after waiting 0 ms 2023-11-26 15:54:54,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3. 2023-11-26 15:54:54,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-26 15:54:54,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-26 15:54:54,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3. 2023-11-26 15:54:54,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 85d1c52a56d6f318e73d9af5da74f3c3: 2023-11-26 15:54:54,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 85d1c52a56d6f318e73d9af5da74f3c3 2023-11-26 15:54:54,871 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=85d1c52a56d6f318e73d9af5da74f3c3, regionState=CLOSED 2023-11-26 15:54:54,871 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1701014094871"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014094871"}]},"ts":"1701014094871"} 2023-11-26 15:54:54,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=77, resume processing ppid=76 2023-11-26 15:54:54,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 85d1c52a56d6f318e73d9af5da74f3c3, server=jenkins-hbase4.apache.org,41861,1701014000937 in 162 msec 2023-11-26 15:54:54,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=76, resume processing ppid=75 2023-11-26 15:54:54,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=85d1c52a56d6f318e73d9af5da74f3c3, UNASSIGN in 166 msec 2023-11-26 15:54:54,877 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014094876"}]},"ts":"1701014094876"} 2023-11-26 15:54:54,878 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-11-26 15:54:54,880 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-11-26 15:54:54,882 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 185 msec 2023-11-26 15:54:55,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-26 15:54:55,006 INFO [Listener at localhost/43645] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-11-26 15:54:55,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-11-26 15:54:55,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-11-26 15:54:55,018 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-26 15:54:55,019 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-26 15:54:55,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-26 15:54:55,022 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3 2023-11-26 15:54:55,025 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1, FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/recovered.edits] 2023-11-26 15:54:55,029 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/48b791883b2c4a0491905fbbf9282dbf to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/48b791883b2c4a0491905fbbf9282dbf 2023-11-26 15:54:55,030 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/f1/be750eaa22764324ae10bc8bf1b69e33 2023-11-26 15:54:55,033 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/recovered.edits/15.seqid to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3/recovered.edits/15.seqid 2023-11-26 15:54:55,034 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testGetAfterCompaction/85d1c52a56d6f318e73d9af5da74f3c3 2023-11-26 15:54:55,034 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-26 15:54:55,034 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-26 15:54:55,035 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-11-26 15:54:55,039 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023112621ebf207a4814cd681b6bd96f668bfe9 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023112621ebf207a4814cd681b6bd96f668bfe9 2023-11-26 15:54:55,039 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-26 15:54:55,042 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-26 15:54:55,069 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-11-26 15:54:55,072 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-11-26 15:54:55,073 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-26 15:54:55,073 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-11-26 15:54:55,073 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1701014095073"}]},"ts":"9223372036854775807"} 2023-11-26 15:54:55,077 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-11-26 15:54:55,077 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 85d1c52a56d6f318e73d9af5da74f3c3, NAME => 'testGetAfterCompaction,,1701014089245.85d1c52a56d6f318e73d9af5da74f3c3.', STARTKEY => '', ENDKEY => ''}] 2023-11-26 15:54:55,077 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-11-26 15:54:55,077 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1701014095077"}]},"ts":"9223372036854775807"} 2023-11-26 15:54:55,079 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-11-26 15:54:55,081 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-26 15:54:55,082 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 70 msec 2023-11-26 15:54:55,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-26 15:54:55,121 INFO [Listener at localhost/43645] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-11-26 15:54:55,134 INFO [Listener at localhost/43645] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=238 (was 244), OpenFileDescriptor=622 (was 641), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=167 (was 173), ProcessCount=171 (was 171), AvailableMemoryMB=8282 (was 8332) 2023-11-26 15:54:55,144 INFO [Listener at localhost/43645] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=238, OpenFileDescriptor=622, MaxFileDescriptor=60000, SystemLoadAverage=167, ProcessCount=171, AvailableMemoryMB=8281 2023-11-26 15:54:55,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-26 15:54:55,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-11-26 15:54:55,148 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-11-26 15:54:55,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-11-26 15:54:55,148 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-26 15:54:55,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-26 15:54:55,150 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:54:55,150 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:54:55,152 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6 2023-11-26 15:54:55,152 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1 empty. 2023-11-26 15:54:55,153 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6 empty. 2023-11-26 15:54:55,153 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746 empty. 2023-11-26 15:54:55,153 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:54:55,153 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6 2023-11-26 15:54:55,153 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:54:55,153 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-11-26 15:54:55,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-26 15:54:55,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-26 15:54:55,563 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-26 15:54:55,565 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 900c2d000cb588ea26813112d428c4a6, NAME => 'testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:54:55,565 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1cc117e24a014df5815461dcd6bc9ce1, NAME => 'testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:54:55,565 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => dd287aba04977d5f4b3a261b02c79746, NAME => 'testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:54:55,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-26 15:54:55,975 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:55,975 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing dd287aba04977d5f4b3a261b02c79746, disabling compactions & flushes 2023-11-26 15:54:55,975 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:54:55,975 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:54:55,975 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. after waiting 0 ms 2023-11-26 15:54:55,975 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:54:55,975 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:54:55,975 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for dd287aba04977d5f4b3a261b02c79746: 2023-11-26 15:54:55,978 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:55,978 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 1cc117e24a014df5815461dcd6bc9ce1, disabling compactions & flushes 2023-11-26 15:54:55,978 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:54:55,978 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:54:55,978 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. after waiting 0 ms 2023-11-26 15:54:55,978 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:54:55,978 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:54:55,978 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 1cc117e24a014df5815461dcd6bc9ce1: 2023-11-26 15:54:55,979 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:55,979 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 900c2d000cb588ea26813112d428c4a6, disabling compactions & flushes 2023-11-26 15:54:55,979 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:54:55,979 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:54:55,979 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. after waiting 0 ms 2023-11-26 15:54:55,979 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:54:55,979 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:54:55,979 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 900c2d000cb588ea26813112d428c4a6: 2023-11-26 15:54:55,981 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-11-26 15:54:55,982 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701014095982"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014095982"}]},"ts":"1701014095982"} 2023-11-26 15:54:55,982 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701014095982"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014095982"}]},"ts":"1701014095982"} 2023-11-26 15:54:55,982 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701014095982"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014095982"}]},"ts":"1701014095982"} 2023-11-26 15:54:55,984 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-26 15:54:55,985 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-26 15:54:55,985 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014095985"}]},"ts":"1701014095985"} 2023-11-26 15:54:55,986 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-26 15:54:55,992 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1cc117e24a014df5815461dcd6bc9ce1, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dd287aba04977d5f4b3a261b02c79746, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=900c2d000cb588ea26813112d428c4a6, ASSIGN}] 2023-11-26 15:54:55,994 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1cc117e24a014df5815461dcd6bc9ce1, ASSIGN 2023-11-26 15:54:55,994 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=900c2d000cb588ea26813112d428c4a6, ASSIGN 2023-11-26 15:54:55,994 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dd287aba04977d5f4b3a261b02c79746, ASSIGN 2023-11-26 15:54:55,994 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1cc117e24a014df5815461dcd6bc9ce1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:54:55,994 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dd287aba04977d5f4b3a261b02c79746, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:54:55,994 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=900c2d000cb588ea26813112d428c4a6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:54:56,146 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=1cc117e24a014df5815461dcd6bc9ce1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:56,146 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=dd287aba04977d5f4b3a261b02c79746, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:56,146 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701014096146"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014096146"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014096146"}]},"ts":"1701014096146"} 2023-11-26 15:54:56,146 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=900c2d000cb588ea26813112d428c4a6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:56,146 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701014096146"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014096146"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014096146"}]},"ts":"1701014096146"} 2023-11-26 15:54:56,147 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701014096146"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014096146"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014096146"}]},"ts":"1701014096146"} 2023-11-26 15:54:56,148 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure 1cc117e24a014df5815461dcd6bc9ce1, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:54:56,149 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure dd287aba04977d5f4b3a261b02c79746, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:54:56,150 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure 900c2d000cb588ea26813112d428c4a6, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:54:56,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-26 15:54:56,301 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:56,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:54:56,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dd287aba04977d5f4b3a261b02c79746, NAME => 'testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746.', STARTKEY => '1', ENDKEY => '2'} 2023-11-26 15:54:56,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:54:56,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:56,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:54:56,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:54:56,305 INFO [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:54:56,306 DEBUG [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1 2023-11-26 15:54:56,307 DEBUG [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1 2023-11-26 15:54:56,307 INFO [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd287aba04977d5f4b3a261b02c79746 columnFamilyName family1 2023-11-26 15:54:56,308 INFO [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] regionserver.HStore(310): Store=dd287aba04977d5f4b3a261b02c79746/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:54:56,308 INFO [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:54:56,309 DEBUG [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2 2023-11-26 15:54:56,309 DEBUG [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2 2023-11-26 15:54:56,310 INFO [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd287aba04977d5f4b3a261b02c79746 columnFamilyName family2 2023-11-26 15:54:56,311 INFO [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] regionserver.HStore(310): Store=dd287aba04977d5f4b3a261b02c79746/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:54:56,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:54:56,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:54:56,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-26 15:54:56,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:54:56,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:54:56,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dd287aba04977d5f4b3a261b02c79746; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65169084, jitterRate=-0.028904974460601807}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-26 15:54:56,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dd287aba04977d5f4b3a261b02c79746: 2023-11-26 15:54:56,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746., pid=84, masterSystemTime=1701014096301 2023-11-26 15:54:56,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:54:56,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:54:56,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:54:56,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 900c2d000cb588ea26813112d428c4a6, NAME => 'testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6.', STARTKEY => '2', ENDKEY => ''} 2023-11-26 15:54:56,320 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=dd287aba04977d5f4b3a261b02c79746, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:56,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 900c2d000cb588ea26813112d428c4a6 2023-11-26 15:54:56,320 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701014096320"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014096320"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014096320"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014096320"}]},"ts":"1701014096320"} 2023-11-26 15:54:56,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:56,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 900c2d000cb588ea26813112d428c4a6 2023-11-26 15:54:56,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 900c2d000cb588ea26813112d428c4a6 2023-11-26 15:54:56,322 INFO [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 900c2d000cb588ea26813112d428c4a6 2023-11-26 15:54:56,323 DEBUG [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1 2023-11-26 15:54:56,323 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=84, resume processing ppid=81 2023-11-26 15:54:56,323 DEBUG [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1 2023-11-26 15:54:56,324 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure dd287aba04977d5f4b3a261b02c79746, server=jenkins-hbase4.apache.org,41861,1701014000937 in 174 msec 2023-11-26 15:54:56,324 INFO [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 900c2d000cb588ea26813112d428c4a6 columnFamilyName family1 2023-11-26 15:54:56,324 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dd287aba04977d5f4b3a261b02c79746, ASSIGN in 332 msec 2023-11-26 15:54:56,324 INFO [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] regionserver.HStore(310): Store=900c2d000cb588ea26813112d428c4a6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:54:56,325 INFO [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 900c2d000cb588ea26813112d428c4a6 2023-11-26 15:54:56,326 DEBUG [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2 2023-11-26 15:54:56,326 DEBUG [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2 2023-11-26 15:54:56,326 INFO [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 900c2d000cb588ea26813112d428c4a6 columnFamilyName family2 2023-11-26 15:54:56,327 INFO [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] regionserver.HStore(310): Store=900c2d000cb588ea26813112d428c4a6/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:54:56,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6 2023-11-26 15:54:56,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6 2023-11-26 15:54:56,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-26 15:54:56,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 900c2d000cb588ea26813112d428c4a6 2023-11-26 15:54:56,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:54:56,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 900c2d000cb588ea26813112d428c4a6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74723792, jitterRate=0.11347126960754395}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-26 15:54:56,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 900c2d000cb588ea26813112d428c4a6: 2023-11-26 15:54:56,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6., pid=85, masterSystemTime=1701014096301 2023-11-26 15:54:56,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:54:56,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:54:56,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:54:56,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1cc117e24a014df5815461dcd6bc9ce1, NAME => 'testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1.', STARTKEY => '', ENDKEY => '1'} 2023-11-26 15:54:56,334 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=900c2d000cb588ea26813112d428c4a6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:56,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:54:56,335 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701014096334"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014096334"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014096334"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014096334"}]},"ts":"1701014096334"} 2023-11-26 15:54:56,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:54:56,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:54:56,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:54:56,336 INFO [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:54:56,337 DEBUG [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1 2023-11-26 15:54:56,337 DEBUG [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1 2023-11-26 15:54:56,337 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=85, resume processing ppid=82 2023-11-26 15:54:56,337 INFO [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1cc117e24a014df5815461dcd6bc9ce1 columnFamilyName family1 2023-11-26 15:54:56,337 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure 900c2d000cb588ea26813112d428c4a6, server=jenkins-hbase4.apache.org,41861,1701014000937 in 187 msec 2023-11-26 15:54:56,338 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=900c2d000cb588ea26813112d428c4a6, ASSIGN in 345 msec 2023-11-26 15:54:56,338 INFO [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] regionserver.HStore(310): Store=1cc117e24a014df5815461dcd6bc9ce1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:54:56,338 INFO [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:54:56,339 DEBUG [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2 2023-11-26 15:54:56,339 DEBUG [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2 2023-11-26 15:54:56,339 INFO [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1cc117e24a014df5815461dcd6bc9ce1 columnFamilyName family2 2023-11-26 15:54:56,340 INFO [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] regionserver.HStore(310): Store=1cc117e24a014df5815461dcd6bc9ce1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:54:56,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:54:56,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:54:56,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-26 15:54:56,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:54:56,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:54:56,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1cc117e24a014df5815461dcd6bc9ce1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61786636, jitterRate=-0.07930737733840942}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-26 15:54:56,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1cc117e24a014df5815461dcd6bc9ce1: 2023-11-26 15:54:56,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1., pid=83, masterSystemTime=1701014096301 2023-11-26 15:54:56,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:54:56,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:54:56,347 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=1cc117e24a014df5815461dcd6bc9ce1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:56,348 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701014096347"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014096347"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014096347"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014096347"}]},"ts":"1701014096347"} 2023-11-26 15:54:56,350 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=83, resume processing ppid=80 2023-11-26 15:54:56,350 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure 1cc117e24a014df5815461dcd6bc9ce1, server=jenkins-hbase4.apache.org,41861,1701014000937 in 201 msec 2023-11-26 15:54:56,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=80, resume processing ppid=79 2023-11-26 15:54:56,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1cc117e24a014df5815461dcd6bc9ce1, ASSIGN in 359 msec 2023-11-26 15:54:56,352 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-26 15:54:56,352 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014096352"}]},"ts":"1701014096352"} 2023-11-26 15:54:56,353 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-26 15:54:56,355 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-11-26 15:54:56,356 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2090 sec 2023-11-26 15:54:57,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-26 15:54:57,254 INFO [Listener at localhost/43645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-11-26 15:54:57,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:54:57,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:54:57,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:54:57,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:57,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-26 15:54:57,270 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-26 15:54:57,270 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:57,270 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-26 15:54:57,270 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-26 15:54:57,270 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:54:57,270 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:54:57,272 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:57,272 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:57,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:57,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:57,272 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:57,272 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:57,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:54:57,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:54:57,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:57,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:54:57,273 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-26 15:54:57,273 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-26 15:54:57,273 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-26 15:54:57,273 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:57,273 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-26 15:54:57,275 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:54:57,275 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-26 15:54:57,276 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:54:57,276 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:54:57,276 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:57,276 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. started... 2023-11-26 15:54:57,276 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. started... 2023-11-26 15:54:57,276 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. started... 2023-11-26 15:54:57,277 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1cc117e24a014df5815461dcd6bc9ce1 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-26 15:54:57,277 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 900c2d000cb588ea26813112d428c4a6 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-26 15:54:57,277 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dd287aba04977d5f4b3a261b02c79746 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-26 15:54:57,697 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126249a37657ef94cb7b3447b02179b0f32 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231126249a37657ef94cb7b3447b02179b0f32 2023-11-26 15:54:57,697 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112626244e342f2148cc85bd213afba54445 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112626244e342f2148cc85bd213afba54445 2023-11-26 15:54:57,698 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231126d85d0ccc0670444e8124edf44cdfbeee to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126d85d0ccc0670444e8124edf44cdfbeee 2023-11-26 15:54:58,106 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family1/68b01851f116456fb29a8a135104f863 2023-11-26 15:54:58,107 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family1/4aa05e8735e14d5fb85a30feb64b6842 2023-11-26 15:54:58,107 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family1/47741ead1ae940b2a3fc6b01ddd532bb 2023-11-26 15:54:58,525 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231126b2366e528a694d43904b1d15abc11f8e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231126b2366e528a694d43904b1d15abc11f8e 2023-11-26 15:54:58,525 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-26 15:54:58,527 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311269c1dce9ee81b4eff8a281c4f33f2311a to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311269c1dce9ee81b4eff8a281c4f33f2311a 2023-11-26 15:54:58,528 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311264eaf9751c4ee402dbcb5bfa22d520f29 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311264eaf9751c4ee402dbcb5bfa22d520f29 2023-11-26 15:54:58,930 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family2/75f40a13c3774903aa3895831d86437c 2023-11-26 15:54:58,932 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family2/4e1ed16f3099408f9b236ea81463ad33 2023-11-26 15:54:58,934 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family2/4018d6308c69481b80b6f546d1b9f244 2023-11-26 15:54:58,938 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family1/4aa05e8735e14d5fb85a30feb64b6842 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/4aa05e8735e14d5fb85a30feb64b6842 2023-11-26 15:54:58,939 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family1/47741ead1ae940b2a3fc6b01ddd532bb as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/47741ead1ae940b2a3fc6b01ddd532bb 2023-11-26 15:54:58,942 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/4aa05e8735e14d5fb85a30feb64b6842, entries=4, sequenceid=5, filesize=5.4 K 2023-11-26 15:54:58,942 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family2/4e1ed16f3099408f9b236ea81463ad33 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/4e1ed16f3099408f9b236ea81463ad33 2023-11-26 15:54:58,943 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/47741ead1ae940b2a3fc6b01ddd532bb, entries=4, sequenceid=5, filesize=5.4 K 2023-11-26 15:54:58,944 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family2/4018d6308c69481b80b6f546d1b9f244 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/4018d6308c69481b80b6f546d1b9f244 2023-11-26 15:54:58,947 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/4e1ed16f3099408f9b236ea81463ad33, entries=2, sequenceid=5, filesize=5.1 K 2023-11-26 15:54:58,948 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/4018d6308c69481b80b6f546d1b9f244, entries=2, sequenceid=5, filesize=5.1 K 2023-11-26 15:54:58,948 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 900c2d000cb588ea26813112d428c4a6 in 1671ms, sequenceid=5, compaction requested=false 2023-11-26 15:54:58,949 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 900c2d000cb588ea26813112d428c4a6: 2023-11-26 15:54:58,949 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:54:58,949 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-26 15:54:58,949 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for dd287aba04977d5f4b3a261b02c79746 in 1673ms, sequenceid=5, compaction requested=false 2023-11-26 15:54:58,949 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dd287aba04977d5f4b3a261b02c79746: 2023-11-26 15:54:58,949 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:54:58,949 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-26 15:54:58,950 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family1/68b01851f116456fb29a8a135104f863 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/68b01851f116456fb29a8a135104f863 2023-11-26 15:54:58,954 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/68b01851f116456fb29a8a135104f863, entries=4, sequenceid=5, filesize=5.4 K 2023-11-26 15:54:58,954 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family2/75f40a13c3774903aa3895831d86437c as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/75f40a13c3774903aa3895831d86437c 2023-11-26 15:54:58,959 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/75f40a13c3774903aa3895831d86437c, entries=2, sequenceid=5, filesize=5.1 K 2023-11-26 15:54:58,959 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1cc117e24a014df5815461dcd6bc9ce1 in 1683ms, sequenceid=5, compaction requested=false 2023-11-26 15:54:58,959 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1cc117e24a014df5815461dcd6bc9ce1: 2023-11-26 15:54:58,959 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:54:58,959 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-26 15:54:58,959 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-26 15:54:58,959 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:58,960 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-26 15:54:58,960 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-26 15:54:58,961 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:58,961 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:54:58,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:58,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:58,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:58,962 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:54:58,962 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:54:58,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:58,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:58,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:54:58,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:58,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:58,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-26 15:54:58,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7170d73d[Count = 0] remaining members to acquire global barrier 2023-11-26 15:54:58,964 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-26 15:54:58,964 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:54:58,965 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:54:58,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:54:58,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:54:58,966 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-26 15:54:58,966 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-26 15:54:58,966 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:58,966 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:54:58,966 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:54:58,967 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-26 15:54:58,967 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:58,967 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:58,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:58,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:58,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:58,967 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-26 15:54:58,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:58,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:58,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:54:58,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:58,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:58,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:54:58,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:58,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:54:58,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-26 15:54:58,970 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-26 15:54:58,970 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:54:58,970 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:54:58,970 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-26 15:54:58,970 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:54:58,972 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:54:58,972 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:54:58,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:54:58,972 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:58,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:54:58,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:54:58,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:54:58,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:54:58,972 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:58,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:58,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:58,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:54:58,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:54:58,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:54:58,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:54:58,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:54:58,974 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:58,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:58,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:54:58,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:54:58,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:58,976 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:58,976 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:54:58,976 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:54:58,976 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:58,976 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:58,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-26 15:54:58,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:54:58,976 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:54:58,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:58,976 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-26 15:54:58,976 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:54:58,976 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:54:58,976 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-26 15:54:58,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:58,976 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:54:58,976 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:54:58,977 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:54:58,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:54:58,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:54:59,077 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:54:59,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:54:59,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:54:59,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:54:59,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:54:59,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:54:59,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-26 15:54:59,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-26 15:54:59,083 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-26 15:54:59,083 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:59,083 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-26 15:54:59,083 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-26 15:54:59,084 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:54:59,084 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:54:59,089 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:59,089 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:54:59,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:54:59,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:54:59,089 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:54:59,089 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:54:59,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:54:59,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:54:59,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:54:59,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:54:59,090 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-26 15:54:59,090 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-26 15:54:59,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-26 15:54:59,090 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-26 15:54:59,090 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:54:59,091 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-26 15:54:59,091 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:54:59,091 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. started... 2023-11-26 15:54:59,091 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:54:59,091 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:54:59,091 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. started... 2023-11-26 15:54:59,091 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-26 15:54:59,091 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:54:59,091 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dd287aba04977d5f4b3a261b02c79746 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-26 15:54:59,091 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. started... 2023-11-26 15:54:59,091 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1cc117e24a014df5815461dcd6bc9ce1 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-26 15:54:59,091 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 900c2d000cb588ea26813112d428c4a6 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-26 15:54:59,511 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231126d7332dc0e7af47ca941c153160b7f096 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126d7332dc0e7af47ca941c153160b7f096 2023-11-26 15:54:59,511 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311262aa1b154e66842c99a229dce9c76af5e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311262aa1b154e66842c99a229dce9c76af5e 2023-11-26 15:54:59,512 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126f11df26d44774221847b9915bc03112c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231126f11df26d44774221847b9915bc03112c 2023-11-26 15:54:59,919 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family1/878fdc9fd5214d9e901aca452f0b5369 2023-11-26 15:54:59,923 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family1/2753710c7d794b5884b18c02f38e9bcd 2023-11-26 15:54:59,923 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family1/21da28f4f1cb446b92af01b16ceb0784 2023-11-26 15:54:59,937 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112642a886bb2ba34c1196639724b4352a7f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112642a886bb2ba34c1196639724b4352a7f 2023-11-26 15:55:00,346 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126e80130657a9f4fe3b4d13d20f6e3668f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231126e80130657a9f4fe3b4d13d20f6e3668f 2023-11-26 15:55:00,347 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family2/ca383d22f31c49e79ff543bd09b71dba 2023-11-26 15:55:00,349 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311264ca0d257509645bbb3ce8e0903f901da to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311264ca0d257509645bbb3ce8e0903f901da 2023-11-26 15:55:00,352 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family2/ae016fb6728f4cbeb72c54a92d72395f 2023-11-26 15:55:00,356 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family1/21da28f4f1cb446b92af01b16ceb0784 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/21da28f4f1cb446b92af01b16ceb0784 2023-11-26 15:55:00,356 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family1/878fdc9fd5214d9e901aca452f0b5369 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/878fdc9fd5214d9e901aca452f0b5369 2023-11-26 15:55:00,360 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/21da28f4f1cb446b92af01b16ceb0784, entries=4, sequenceid=9, filesize=5.4 K 2023-11-26 15:55:00,360 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/878fdc9fd5214d9e901aca452f0b5369, entries=4, sequenceid=9, filesize=5.4 K 2023-11-26 15:55:00,360 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family2/ae016fb6728f4cbeb72c54a92d72395f as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/ae016fb6728f4cbeb72c54a92d72395f 2023-11-26 15:55:00,360 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family2/ca383d22f31c49e79ff543bd09b71dba as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/ca383d22f31c49e79ff543bd09b71dba 2023-11-26 15:55:00,364 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/ae016fb6728f4cbeb72c54a92d72395f, entries=2, sequenceid=9, filesize=5.1 K 2023-11-26 15:55:00,364 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/ca383d22f31c49e79ff543bd09b71dba, entries=2, sequenceid=9, filesize=5.1 K 2023-11-26 15:55:00,364 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 900c2d000cb588ea26813112d428c4a6 in 1273ms, sequenceid=9, compaction requested=false 2023-11-26 15:55:00,364 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 900c2d000cb588ea26813112d428c4a6: 2023-11-26 15:55:00,365 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:55:00,365 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-26 15:55:00,365 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for dd287aba04977d5f4b3a261b02c79746 in 1274ms, sequenceid=9, compaction requested=false 2023-11-26 15:55:00,365 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dd287aba04977d5f4b3a261b02c79746: 2023-11-26 15:55:00,365 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:55:00,365 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-26 15:55:00,370 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-26 15:55:00,755 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family2/346fe445f40d49e5acba25945590457f 2023-11-26 15:55:00,760 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family1/2753710c7d794b5884b18c02f38e9bcd as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/2753710c7d794b5884b18c02f38e9bcd 2023-11-26 15:55:00,763 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/2753710c7d794b5884b18c02f38e9bcd, entries=4, sequenceid=9, filesize=5.4 K 2023-11-26 15:55:00,764 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family2/346fe445f40d49e5acba25945590457f as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/346fe445f40d49e5acba25945590457f 2023-11-26 15:55:00,769 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/346fe445f40d49e5acba25945590457f, entries=2, sequenceid=9, filesize=5.1 K 2023-11-26 15:55:00,770 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1cc117e24a014df5815461dcd6bc9ce1 in 1679ms, sequenceid=9, compaction requested=false 2023-11-26 15:55:00,770 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1cc117e24a014df5815461dcd6bc9ce1: 2023-11-26 15:55:00,770 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:55:00,770 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-26 15:55:00,770 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-26 15:55:00,770 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:00,770 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-26 15:55:00,770 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-26 15:55:00,774 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:00,775 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:00,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:00,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:00,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:00,775 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:00,775 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:00,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:00,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:00,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:00,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:00,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:00,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-26 15:55:00,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ef3576e[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:00,776 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-26 15:55:00,776 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:00,778 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:00,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:00,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:00,778 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-26 15:55:00,778 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-26 15:55:00,778 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:00,778 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:00,778 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:00,780 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-26 15:55:00,780 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:00,780 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:00,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:00,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:00,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:00,780 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-26 15:55:00,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:00,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:00,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:00,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:00,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:00,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:00,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:00,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:00,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-26 15:55:00,783 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-26 15:55:00,783 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:00,783 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:00,783 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-26 15:55:00,783 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:00,784 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:00,784 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:00,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:00,785 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:00,785 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:00,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:00,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:00,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:00,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:00,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:00,787 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:00,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:00,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:00,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:00,789 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:00,789 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:55:00,789 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:55:00,789 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:00,789 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:00,789 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:00,789 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:00,789 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:00,789 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:00,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:00,789 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:00,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:00,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:00,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-26 15:55:00,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:00,792 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:00,792 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:00,893 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:00,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:00,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:00,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:00,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:00,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:00,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-26 15:55:00,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-26 15:55:00,899 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-26 15:55:00,899 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:00,899 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-26 15:55:00,899 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-26 15:55:00,900 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:00,900 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:55:00,901 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:00,901 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:00,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:00,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:00,902 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:00,902 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:00,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:55:00,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:00,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:00,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:55:00,903 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-26 15:55:00,903 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-26 15:55:00,903 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-26 15:55:00,903 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-26 15:55:00,903 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:00,903 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-26 15:55:00,903 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:55:00,903 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. started... 2023-11-26 15:55:00,903 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:55:00,903 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-26 15:55:00,904 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:55:00,903 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. started... 2023-11-26 15:55:00,904 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. started... 2023-11-26 15:55:00,904 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dd287aba04977d5f4b3a261b02c79746 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-26 15:55:00,904 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 900c2d000cb588ea26813112d428c4a6 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-26 15:55:00,904 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:00,904 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1cc117e24a014df5815461dcd6bc9ce1 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-26 15:55:01,329 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311262a00b7a0281d4b98a765c16de254c7d3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311262a00b7a0281d4b98a765c16de254c7d3 2023-11-26 15:55:01,329 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231126b68fac10445849b8bdd52d3cdac0bf27 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126b68fac10445849b8bdd52d3cdac0bf27 2023-11-26 15:55:01,332 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231126c3828775b0b84bb2b7b1033d80fa6517 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231126c3828775b0b84bb2b7b1033d80fa6517 2023-11-26 15:55:01,739 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family1/b17df9b698254d84845aab04224498f4 2023-11-26 15:55:01,740 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family1/a93aa2aec72947c38938f30dcd338726 2023-11-26 15:55:01,740 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family1/081ad50692d243e28d9e522b92b508e8 2023-11-26 15:55:02,155 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126944bc4f460684b31b4941a4538813a38 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231126944bc4f460684b31b4941a4538813a38 2023-11-26 15:55:02,159 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family2/f0d0cc00a77e455cadab119cbdd6bc90 2023-11-26 15:55:02,163 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231126789ff6fb1e6d496e89016bed196e7e0d to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231126789ff6fb1e6d496e89016bed196e7e0d 2023-11-26 15:55:02,163 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112622c3dae8f3344fc593443697473b1c1a to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112622c3dae8f3344fc593443697473b1c1a 2023-11-26 15:55:02,164 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family1/a93aa2aec72947c38938f30dcd338726 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/a93aa2aec72947c38938f30dcd338726 2023-11-26 15:55:02,169 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family2/fde91b6e09f84eea9754e2c4ddb510b5 2023-11-26 15:55:02,169 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/a93aa2aec72947c38938f30dcd338726, entries=4, sequenceid=13, filesize=5.4 K 2023-11-26 15:55:02,173 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family2/f0d0cc00a77e455cadab119cbdd6bc90 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/f0d0cc00a77e455cadab119cbdd6bc90 2023-11-26 15:55:02,176 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family1/b17df9b698254d84845aab04224498f4 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/b17df9b698254d84845aab04224498f4 2023-11-26 15:55:02,176 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/f0d0cc00a77e455cadab119cbdd6bc90, entries=2, sequenceid=13, filesize=5.1 K 2023-11-26 15:55:02,177 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 900c2d000cb588ea26813112d428c4a6 in 1273ms, sequenceid=13, compaction requested=true 2023-11-26 15:55:02,177 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 900c2d000cb588ea26813112d428c4a6: 2023-11-26 15:55:02,177 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:55:02,177 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-26 15:55:02,179 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/b17df9b698254d84845aab04224498f4, entries=4, sequenceid=13, filesize=5.4 K 2023-11-26 15:55:02,180 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family2/fde91b6e09f84eea9754e2c4ddb510b5 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/fde91b6e09f84eea9754e2c4ddb510b5 2023-11-26 15:55:02,183 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/fde91b6e09f84eea9754e2c4ddb510b5, entries=2, sequenceid=13, filesize=5.1 K 2023-11-26 15:55:02,184 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for dd287aba04977d5f4b3a261b02c79746 in 1281ms, sequenceid=13, compaction requested=true 2023-11-26 15:55:02,184 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dd287aba04977d5f4b3a261b02c79746: 2023-11-26 15:55:02,184 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:55:02,184 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-26 15:55:02,570 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family2/2e3094c168c0454ca21dfb7e9c4724cc 2023-11-26 15:55:02,575 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family1/081ad50692d243e28d9e522b92b508e8 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/081ad50692d243e28d9e522b92b508e8 2023-11-26 15:55:02,579 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/081ad50692d243e28d9e522b92b508e8, entries=4, sequenceid=13, filesize=5.4 K 2023-11-26 15:55:02,579 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family2/2e3094c168c0454ca21dfb7e9c4724cc as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/2e3094c168c0454ca21dfb7e9c4724cc 2023-11-26 15:55:02,583 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/2e3094c168c0454ca21dfb7e9c4724cc, entries=2, sequenceid=13, filesize=5.1 K 2023-11-26 15:55:02,584 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1cc117e24a014df5815461dcd6bc9ce1 in 1680ms, sequenceid=13, compaction requested=true 2023-11-26 15:55:02,584 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1cc117e24a014df5815461dcd6bc9ce1: 2023-11-26 15:55:02,584 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:55:02,584 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-26 15:55:02,584 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-26 15:55:02,584 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:02,584 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-26 15:55:02,584 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-26 15:55:02,586 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:02,586 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:02,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:02,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:02,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:02,586 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:02,586 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:02,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:02,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:02,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:02,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:02,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:02,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-26 15:55:02,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20f6dbe9[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:02,588 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-26 15:55:02,588 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:02,589 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:02,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:02,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:02,589 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-26 15:55:02,589 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:02,589 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:02,589 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-26 15:55:02,589 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:02,591 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-26 15:55:02,591 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:02,591 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:02,591 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-26 15:55:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:02,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:02,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:02,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:02,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:02,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:02,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:02,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:02,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:02,593 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-26 15:55:02,593 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-26 15:55:02,594 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:02,594 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:02,594 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-26 15:55:02,594 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:02,596 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:02,596 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:02,596 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:02,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:02,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:02,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:02,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:02,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:02,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:02,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:02,597 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:02,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:02,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:02,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:02,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:02,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:02,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:02,598 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:02,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:02,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:02,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:02,600 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:02,601 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:55:02,601 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:55:02,601 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:02,601 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:02,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:02,601 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:02,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:02,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-26 15:55:02,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:02,601 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:02,601 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:02,601 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:02,601 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:02,601 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:02,601 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:02,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:02,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:02,701 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:02,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:02,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:02,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:02,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:02,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:02,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-26 15:55:02,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-26 15:55:02,708 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-26 15:55:02,708 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:02,708 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-26 15:55:02,708 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-26 15:55:02,708 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:02,708 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:55:02,710 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:02,710 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:02,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:02,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:02,710 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:02,710 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:02,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:55:02,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:02,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:02,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:55:02,711 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-26 15:55:02,711 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-26 15:55:02,711 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-26 15:55:02,711 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-26 15:55:02,711 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:02,711 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-26 15:55:02,711 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:55:02,711 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. started... 2023-11-26 15:55:02,711 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:55:02,711 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-26 15:55:02,711 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:55:02,711 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dd287aba04977d5f4b3a261b02c79746 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-26 15:55:02,711 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:02,711 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. started... 2023-11-26 15:55:02,711 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. started... 2023-11-26 15:55:02,712 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 900c2d000cb588ea26813112d428c4a6 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-26 15:55:02,712 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1cc117e24a014df5815461dcd6bc9ce1 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-26 15:55:02,743 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311269e01de33b3da4b5c9c6a706aa82213c6 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311269e01de33b3da4b5c9c6a706aa82213c6 2023-11-26 15:55:02,745 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231126123260774e834fc6913eb37fd795185d to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231126123260774e834fc6913eb37fd795185d 2023-11-26 15:55:02,745 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126e6381db945a24f54844a145429b91d6a to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231126e6381db945a24f54844a145429b91d6a 2023-11-26 15:55:03,158 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family1/646cfe52791142b4939f824adab394a1 2023-11-26 15:55:03,167 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family1/28077643ac3d4174a87e2a86d0d4ce53 2023-11-26 15:55:03,167 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family1/1fe28b79aa0940e6b580460106e65974 2023-11-26 15:55:03,180 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311266a7d047d3d674609810e7ffd826eb3fc to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311266a7d047d3d674609810e7ffd826eb3fc 2023-11-26 15:55:03,573 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311262b6a92aed53e4f969a711b9777cad8e9 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311262b6a92aed53e4f969a711b9777cad8e9 2023-11-26 15:55:03,581 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231126d799bcec843046bcac68dc9df5188195 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231126d799bcec843046bcac68dc9df5188195 2023-11-26 15:55:03,585 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family2/8894fcc417754593ad6289f843cc9dfc 2023-11-26 15:55:03,585 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family2/026fd04c221d45a0b392c3c766ac455e 2023-11-26 15:55:03,589 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family1/1fe28b79aa0940e6b580460106e65974 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/1fe28b79aa0940e6b580460106e65974 2023-11-26 15:55:03,589 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family1/28077643ac3d4174a87e2a86d0d4ce53 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/28077643ac3d4174a87e2a86d0d4ce53 2023-11-26 15:55:03,592 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/1fe28b79aa0940e6b580460106e65974, entries=4, sequenceid=17, filesize=5.4 K 2023-11-26 15:55:03,592 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/28077643ac3d4174a87e2a86d0d4ce53, entries=4, sequenceid=17, filesize=5.4 K 2023-11-26 15:55:03,593 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family2/8894fcc417754593ad6289f843cc9dfc as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/8894fcc417754593ad6289f843cc9dfc 2023-11-26 15:55:03,593 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family2/026fd04c221d45a0b392c3c766ac455e as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/026fd04c221d45a0b392c3c766ac455e 2023-11-26 15:55:03,597 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/8894fcc417754593ad6289f843cc9dfc, entries=2, sequenceid=17, filesize=5.1 K 2023-11-26 15:55:03,597 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/026fd04c221d45a0b392c3c766ac455e, entries=2, sequenceid=17, filesize=5.1 K 2023-11-26 15:55:03,597 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 900c2d000cb588ea26813112d428c4a6 in 885ms, sequenceid=17, compaction requested=true 2023-11-26 15:55:03,597 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 900c2d000cb588ea26813112d428c4a6: 2023-11-26 15:55:03,597 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:55:03,597 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-26 15:55:03,598 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1cc117e24a014df5815461dcd6bc9ce1 in 886ms, sequenceid=17, compaction requested=true 2023-11-26 15:55:03,598 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1cc117e24a014df5815461dcd6bc9ce1: 2023-11-26 15:55:03,598 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:55:03,598 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-26 15:55:03,978 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family2/f1440736d19a48dbadf1b913c334b692 2023-11-26 15:55:03,982 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family1/646cfe52791142b4939f824adab394a1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/646cfe52791142b4939f824adab394a1 2023-11-26 15:55:03,986 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/646cfe52791142b4939f824adab394a1, entries=4, sequenceid=17, filesize=5.4 K 2023-11-26 15:55:03,986 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family2/f1440736d19a48dbadf1b913c334b692 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/f1440736d19a48dbadf1b913c334b692 2023-11-26 15:55:03,991 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/f1440736d19a48dbadf1b913c334b692, entries=2, sequenceid=17, filesize=5.1 K 2023-11-26 15:55:03,992 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for dd287aba04977d5f4b3a261b02c79746 in 1281ms, sequenceid=17, compaction requested=true 2023-11-26 15:55:03,992 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dd287aba04977d5f4b3a261b02c79746: 2023-11-26 15:55:03,992 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:55:03,992 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-26 15:55:03,992 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-26 15:55:03,992 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:03,992 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-26 15:55:03,992 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-26 15:55:03,994 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:03,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:03,994 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:03,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:03,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:03,994 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:03,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:03,994 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:03,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:03,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:03,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:03,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:03,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-26 15:55:03,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@169ea674[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:03,996 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-26 15:55:03,996 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:03,998 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:03,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:03,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:03,998 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-26 15:55:03,998 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-26 15:55:03,998 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:03,998 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:03,998 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:03,999 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-26 15:55:03,999 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:03,999 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:04,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:04,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:04,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:04,000 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-26 15:55:04,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:04,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:04,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:04,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:04,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:04,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:04,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:04,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:04,002 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-26 15:55:04,002 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:04,002 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:04,002 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-26 15:55:04,002 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-26 15:55:04,002 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:04,004 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:04,004 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:04,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:04,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:04,004 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:04,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:04,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:04,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:04,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:04,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:04,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:04,005 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:04,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:04,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:04,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:04,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:04,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:04,006 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:04,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:04,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:04,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:04,008 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:04,008 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:04,008 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:55:04,008 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:04,008 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:55:04,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-26 15:55:04,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:04,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:04,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:04,008 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:04,009 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:04,009 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:04,009 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:04,009 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:04,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:04,009 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:04,009 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:04,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:04,109 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:04,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:04,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1701014104110 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-26 15:55:04,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1701014104120 (current time:1701014104120). 2023-11-26 15:55:04,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-26 15:55:04,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] zookeeper.ReadOnlyZKClient(139): Connect 0x1374eae0 to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:55:04,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e7088a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:55:04,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:55:04,137 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:55:04,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1374eae0 to 127.0.0.1:58210 2023-11-26 15:55:04,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:55:04,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-26 15:55:04,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1701014104110 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-26 15:55:04,148 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.hbase-snapshot, current working dir path: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.hbase-snapshot/.tmp/snaptb-1701014104110 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-26 15:55:04,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-26 15:55:04,158 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-26 15:55:04,159 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1701014704159 2023-11-26 15:55:04,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1701014104110 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-26 15:55:04,160 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1701014104110 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-26 15:55:04,161 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-26 15:55:04,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-26 15:55:04,162 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-11-26 15:55:04,163 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-26 15:55:04,164 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1701014704164 2023-11-26 15:55:04,167 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1701014104110 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:04,167 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-26 15:55:04,267 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-26 15:55:04,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1701014104110 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-26 15:55:04,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1701014104110 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-26 15:55:04,272 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-26 15:55:04,472 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-26 15:55:04,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1701014104110 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-26 15:55:04,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1701014104110 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-26 15:55:04,473 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-26 15:55:04,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1701014104110 2023-11-26 15:55:04,577 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1701014104110' 2023-11-26 15:55:04,577 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-26 15:55:04,577 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1701014104110' starting 'acquire' 2023-11-26 15:55:04,577 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1701014104110', kicking off acquire phase on members. 2023-11-26 15:55:04,577 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1701014104110 2023-11-26 15:55:04,578 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1701014104110 2023-11-26 15:55:04,579 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-26 15:55:04,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-26 15:55:04,579 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1701014104110/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:04,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-26 15:55:04,579 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1701014104110/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:04,579 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:04,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1701014104110 2023-11-26 15:55:04,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1701014104110 2023-11-26 15:55:04,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-11-26 15:55:04,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1701014104110 2023-11-26 15:55:04,580 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1701014104110 from table testCompactionWithHFileLink type FLUSH 2023-11-26 15:55:04,582 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1701014104110 2023-11-26 15:55:04,582 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1701014104110' with timeout 300000ms 2023-11-26 15:55:04,582 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-26 15:55:04,582 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1701014104110' starting 'acquire' stage 2023-11-26 15:55:04,582 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1701014104110' locally acquired 2023-11-26 15:55:04,582 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (snaptb-1701014104110) in zk 2023-11-26 15:55:04,585 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1701014104110/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:04,585 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1701014104110 2023-11-26 15:55:04,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1701014104110/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:04,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:04,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-26 15:55:04,586 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1701014104110 2023-11-26 15:55:04,586 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1701014104110' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:04,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:04,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:04,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701014104110 2023-11-26 15:55:04,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:04,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:04,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'snaptb-1701014104110' on coordinator 2023-11-26 15:55:04,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@612052a5[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:04,587 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1701014104110' starting 'in-barrier' execution. 2023-11-26 15:55:04,587 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1701014104110 2023-11-26 15:55:04,588 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1701014104110 2023-11-26 15:55:04,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1701014104110 2023-11-26 15:55:04,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1701014104110 2023-11-26 15:55:04,589 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1701014104110' received 'reached' from coordinator. 2023-11-26 15:55:04,589 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1701014104110/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:04,589 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:04,590 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:55:04,590 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. started... 2023-11-26 15:55:04,590 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dd287aba04977d5f4b3a261b02c79746: 2023-11-26 15:55:04,591 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746.' region-info for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,591 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:55:04,591 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. started... 2023-11-26 15:55:04,591 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-11-26 15:55:04,592 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 900c2d000cb588ea26813112d428c4a6: 2023-11-26 15:55:04,592 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:55:04,592 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-11-26 15:55:04,592 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6.' region-info for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,592 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. started... 2023-11-26 15:55:04,592 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 1cc117e24a014df5815461dcd6bc9ce1: 2023-11-26 15:55:04,592 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1.' region-info for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,597 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-26 15:55:04,597 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-26 15:55:04,597 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-26 15:55:04,600 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/4aa05e8735e14d5fb85a30feb64b6842, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/21da28f4f1cb446b92af01b16ceb0784, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/a93aa2aec72947c38938f30dcd338726, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/1fe28b79aa0940e6b580460106e65974] hfiles 2023-11-26 15:55:04,600 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/68b01851f116456fb29a8a135104f863, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/2753710c7d794b5884b18c02f38e9bcd, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/081ad50692d243e28d9e522b92b508e8, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/28077643ac3d4174a87e2a86d0d4ce53] hfiles 2023-11-26 15:55:04,600 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/47741ead1ae940b2a3fc6b01ddd532bb, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/878fdc9fd5214d9e901aca452f0b5369, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/b17df9b698254d84845aab04224498f4, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/646cfe52791142b4939f824adab394a1] hfiles 2023-11-26 15:55:04,600 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/47741ead1ae940b2a3fc6b01ddd532bb for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,600 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/68b01851f116456fb29a8a135104f863 for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,600 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/4aa05e8735e14d5fb85a30feb64b6842 for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,603 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/21da28f4f1cb446b92af01b16ceb0784 for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,603 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/878fdc9fd5214d9e901aca452f0b5369 for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,603 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/a93aa2aec72947c38938f30dcd338726 for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/1fe28b79aa0940e6b580460106e65974 for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,603 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/2753710c7d794b5884b18c02f38e9bcd for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/b17df9b698254d84845aab04224498f4 for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/4e1ed16f3099408f9b236ea81463ad33, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/ae016fb6728f4cbeb72c54a92d72395f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/f0d0cc00a77e455cadab119cbdd6bc90, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/8894fcc417754593ad6289f843cc9dfc] hfiles 2023-11-26 15:55:04,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/4e1ed16f3099408f9b236ea81463ad33 for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/646cfe52791142b4939f824adab394a1 for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/ae016fb6728f4cbeb72c54a92d72395f for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/4018d6308c69481b80b6f546d1b9f244, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/ca383d22f31c49e79ff543bd09b71dba, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/fde91b6e09f84eea9754e2c4ddb510b5, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/f1440736d19a48dbadf1b913c334b692] hfiles 2023-11-26 15:55:04,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/4018d6308c69481b80b6f546d1b9f244 for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/081ad50692d243e28d9e522b92b508e8 for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/ca383d22f31c49e79ff543bd09b71dba for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/f0d0cc00a77e455cadab119cbdd6bc90 for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/fde91b6e09f84eea9754e2c4ddb510b5 for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/8894fcc417754593ad6289f843cc9dfc for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/28077643ac3d4174a87e2a86d0d4ce53 for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/f1440736d19a48dbadf1b913c334b692 for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/75f40a13c3774903aa3895831d86437c, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/346fe445f40d49e5acba25945590457f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/2e3094c168c0454ca21dfb7e9c4724cc, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/026fd04c221d45a0b392c3c766ac455e] hfiles 2023-11-26 15:55:04,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/75f40a13c3774903aa3895831d86437c for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/346fe445f40d49e5acba25945590457f for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/2e3094c168c0454ca21dfb7e9c4724cc for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/026fd04c221d45a0b392c3c766ac455e for snapshot=snaptb-1701014104110 2023-11-26 15:55:04,774 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-26 15:55:04,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1701014104110 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-26 15:55:04,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1701014104110 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-26 15:55:04,775 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-26 15:55:05,010 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. completed. 2023-11-26 15:55:05,010 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. completed. 2023-11-26 15:55:05,011 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. completed. 2023-11-26 15:55:05,011 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:55:05,011 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:55:05,010 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:55:05,011 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-11-26 15:55:05,011 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-11-26 15:55:05,011 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-11-26 15:55:05,011 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-11-26 15:55:05,011 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:05,011 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1701014104110' locally completed 2023-11-26 15:55:05,011 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1701014104110' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:05,013 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1701014104110/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:05,013 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1701014104110' has notified controller of completion 2023-11-26 15:55:05,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1701014104110/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:05,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:05,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-26 15:55:05,014 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:05,014 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1701014104110' completed. 2023-11-26 15:55:05,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:05,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:05,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701014104110 2023-11-26 15:55:05,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:05,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:05,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701014104110 2023-11-26 15:55:05,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:05,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1701014104110' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:05,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'snaptb-1701014104110', counting down latch. Waiting for 0 more 2023-11-26 15:55:05,016 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1701014104110' execution completed 2023-11-26 15:55:05,016 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:05,016 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:05,016 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1701014104110 2023-11-26 15:55:05,016 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1701014104110including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-11-26 15:55:05,018 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1701014104110 2023-11-26 15:55:05,018 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1701014104110 2023-11-26 15:55:05,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1701014104110 2023-11-26 15:55:05,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:05,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-26 15:55:05,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1701014104110 2023-11-26 15:55:05,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1701014104110 2023-11-26 15:55:05,018 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-26 15:55:05,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:05,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-26 15:55:05,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-26 15:55:05,019 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1701014104110/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:05,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701014104110 2023-11-26 15:55:05,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1701014104110 2023-11-26 15:55:05,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:05,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701014104110 2023-11-26 15:55:05,024 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1701014104110/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:05,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:05,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:05,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701014104110 2023-11-26 15:55:05,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:05,028 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1701014104110/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:05,028 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-26 15:55:05,028 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1701014104110 2023-11-26 15:55:05,028 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:05,028 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1701014104110 2023-11-26 15:55:05,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1701014104110 because node does not exist (not an error) 2023-11-26 15:55:05,028 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1701014104110 2023-11-26 15:55:05,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-26 15:55:05,028 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-26 15:55:05,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-26 15:55:05,028 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1701014104110/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:05,028 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-11-26 15:55:05,028 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1701014104110 2023-11-26 15:55:05,028 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1701014104110 2023-11-26 15:55:05,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1701014104110 2023-11-26 15:55:05,028 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1701014104110 2023-11-26 15:55:05,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-11-26 15:55:05,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-26 15:55:05,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-26 15:55:05,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311269e01de33b3da4b5c9c6a706aa82213c6, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126b68fac10445849b8bdd52d3cdac0bf27, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126d7332dc0e7af47ca941c153160b7f096, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126d85d0ccc0670444e8124edf44cdfbeee, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231126249a37657ef94cb7b3447b02179b0f32, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311262a00b7a0281d4b98a765c16de254c7d3, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231126e6381db945a24f54844a145429b91d6a, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231126f11df26d44774221847b9915bc03112c, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231126123260774e834fc6913eb37fd795185d, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112626244e342f2148cc85bd213afba54445, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311262aa1b154e66842c99a229dce9c76af5e, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231126c3828775b0b84bb2b7b1033d80fa6517] mob files 2023-11-26 15:55:05,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311269e01de33b3da4b5c9c6a706aa82213c6 2023-11-26 15:55:05,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126b68fac10445849b8bdd52d3cdac0bf27 2023-11-26 15:55:05,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126d7332dc0e7af47ca941c153160b7f096 2023-11-26 15:55:05,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126d85d0ccc0670444e8124edf44cdfbeee 2023-11-26 15:55:05,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231126249a37657ef94cb7b3447b02179b0f32 2023-11-26 15:55:05,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311262a00b7a0281d4b98a765c16de254c7d3 2023-11-26 15:55:05,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231126e6381db945a24f54844a145429b91d6a 2023-11-26 15:55:05,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231126f11df26d44774221847b9915bc03112c 2023-11-26 15:55:05,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231126123260774e834fc6913eb37fd795185d 2023-11-26 15:55:05,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112626244e342f2148cc85bd213afba54445 2023-11-26 15:55:05,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311262aa1b154e66842c99a229dce9c76af5e 2023-11-26 15:55:05,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231126c3828775b0b84bb2b7b1033d80fa6517 2023-11-26 15:55:05,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311262b6a92aed53e4f969a711b9777cad8e9, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112642a886bb2ba34c1196639724b4352a7f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311264eaf9751c4ee402dbcb5bfa22d520f29, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231126789ff6fb1e6d496e89016bed196e7e0d, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311266a7d047d3d674609810e7ffd826eb3fc, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231126944bc4f460684b31b4941a4538813a38, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311269c1dce9ee81b4eff8a281c4f33f2311a, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231126e80130657a9f4fe3b4d13d20f6e3668f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112622c3dae8f3344fc593443697473b1c1a, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311264ca0d257509645bbb3ce8e0903f901da, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231126b2366e528a694d43904b1d15abc11f8e, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231126d799bcec843046bcac68dc9df5188195] mob files 2023-11-26 15:55:05,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311262b6a92aed53e4f969a711b9777cad8e9 2023-11-26 15:55:05,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112642a886bb2ba34c1196639724b4352a7f 2023-11-26 15:55:05,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311264eaf9751c4ee402dbcb5bfa22d520f29 2023-11-26 15:55:05,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231126789ff6fb1e6d496e89016bed196e7e0d 2023-11-26 15:55:05,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311266a7d047d3d674609810e7ffd826eb3fc 2023-11-26 15:55:05,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231126944bc4f460684b31b4941a4538813a38 2023-11-26 15:55:05,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311269c1dce9ee81b4eff8a281c4f33f2311a 2023-11-26 15:55:05,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231126e80130657a9f4fe3b4d13d20f6e3668f 2023-11-26 15:55:05,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112622c3dae8f3344fc593443697473b1c1a 2023-11-26 15:55:05,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311264ca0d257509645bbb3ce8e0903f901da 2023-11-26 15:55:05,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231126b2366e528a694d43904b1d15abc11f8e 2023-11-26 15:55:05,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231126d799bcec843046bcac68dc9df5188195 2023-11-26 15:55:05,275 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-26 15:55:05,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1701014104110 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-26 15:55:05,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1701014104110 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-26 15:55:05,276 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-26 15:55:05,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1701014104110 2023-11-26 15:55:05,440 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.hbase-snapshot/.tmp/snaptb-1701014104110 2023-11-26 15:55:05,881 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.hbase-snapshot/.tmp/snaptb-1701014104110 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.hbase-snapshot/snaptb-1701014104110 2023-11-26 15:55:05,882 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1701014104110 of table testCompactionWithHFileLink completed 2023-11-26 15:55:05,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.hbase-snapshot/.tmp/snaptb-1701014104110 2023-11-26 15:55:05,882 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.hbase-snapshot/.tmp/snaptb-1701014104110 2023-11-26 15:55:05,882 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1701014104110 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1701014104160Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1701014105437 (+1277 ms)Consolidate snapshot: snaptb-1701014104110 at 1701014105438 (+1 ms)Loading Region manifests for snaptb-1701014104110 at 1701014105438Writing data manifest for snaptb-1701014104110 at 1701014105447 (+9 ms)Verifying snapshot: snaptb-1701014104110 at 1701014105854 (+407 ms)Snapshot snaptb-1701014104110 of table testCompactionWithHFileLink completed at 1701014105882 (+28 ms) 2023-11-26 15:55:05,884 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-26 15:55:05,885 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.7230 sec 2023-11-26 15:55:06,276 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-26 15:55:06,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1701014104110 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-26 15:55:06,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1701014104110 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-26 15:55:06,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:06,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-26 15:55:06,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-26 15:55:06,312 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-26 15:55:06,312 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:06,312 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-26 15:55:06,312 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-26 15:55:06,312 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:06,312 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:55:06,314 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:06,314 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:06,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:06,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:06,314 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:06,314 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:06,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:55:06,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:06,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:06,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:55:06,315 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-26 15:55:06,315 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-26 15:55:06,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-26 15:55:06,315 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-26 15:55:06,316 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:06,316 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-26 15:55:06,316 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:55:06,316 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. started... 2023-11-26 15:55:06,316 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dd287aba04977d5f4b3a261b02c79746 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-26 15:55:06,319 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:55:06,319 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-26 15:55:06,319 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:06,319 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. started... 2023-11-26 15:55:06,319 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:55:06,319 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 900c2d000cb588ea26813112d428c4a6 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-26 15:55:06,319 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. started... 2023-11-26 15:55:06,320 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1cc117e24a014df5815461dcd6bc9ce1 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-26 15:55:06,746 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family1/713cb9e1d7814bf08fe464a780645043 2023-11-26 15:55:06,746 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family1/2a5261fe3926480e8bb7bfa3ba9e9308 2023-11-26 15:55:06,750 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family1/38b8c67df4a04cebb7a6f973b29abe4b 2023-11-26 15:55:06,750 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 713cb9e1d7814bf08fe464a780645043 2023-11-26 15:55:06,751 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a5261fe3926480e8bb7bfa3ba9e9308 2023-11-26 15:55:06,753 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38b8c67df4a04cebb7a6f973b29abe4b 2023-11-26 15:55:06,768 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family2/64d10dffd0d54838905657b6d4c8ae71 2023-11-26 15:55:06,771 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64d10dffd0d54838905657b6d4c8ae71 2023-11-26 15:55:06,772 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family1/713cb9e1d7814bf08fe464a780645043 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/713cb9e1d7814bf08fe464a780645043 2023-11-26 15:55:06,775 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 713cb9e1d7814bf08fe464a780645043 2023-11-26 15:55:06,776 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/713cb9e1d7814bf08fe464a780645043, entries=3, sequenceid=24, filesize=5.0 K 2023-11-26 15:55:06,776 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family2/64d10dffd0d54838905657b6d4c8ae71 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/64d10dffd0d54838905657b6d4c8ae71 2023-11-26 15:55:06,780 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64d10dffd0d54838905657b6d4c8ae71 2023-11-26 15:55:06,780 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/64d10dffd0d54838905657b6d4c8ae71, entries=1, sequenceid=24, filesize=5.0 K 2023-11-26 15:55:06,780 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1cc117e24a014df5815461dcd6bc9ce1 in 460ms, sequenceid=24, compaction requested=true 2023-11-26 15:55:06,781 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1cc117e24a014df5815461dcd6bc9ce1: 2023-11-26 15:55:06,781 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:55:06,781 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-26 15:55:07,163 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family2/8b41563b3e514d6f83952994e12f4fe0 2023-11-26 15:55:07,167 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b41563b3e514d6f83952994e12f4fe0 2023-11-26 15:55:07,168 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family1/2a5261fe3926480e8bb7bfa3ba9e9308 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/2a5261fe3926480e8bb7bfa3ba9e9308 2023-11-26 15:55:07,172 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a5261fe3926480e8bb7bfa3ba9e9308 2023-11-26 15:55:07,172 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/2a5261fe3926480e8bb7bfa3ba9e9308, entries=3, sequenceid=24, filesize=5.0 K 2023-11-26 15:55:07,173 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family2/8b41563b3e514d6f83952994e12f4fe0 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/8b41563b3e514d6f83952994e12f4fe0 2023-11-26 15:55:07,177 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b41563b3e514d6f83952994e12f4fe0 2023-11-26 15:55:07,177 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/8b41563b3e514d6f83952994e12f4fe0, entries=1, sequenceid=24, filesize=5.0 K 2023-11-26 15:55:07,178 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 900c2d000cb588ea26813112d428c4a6 in 859ms, sequenceid=24, compaction requested=true 2023-11-26 15:55:07,178 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 900c2d000cb588ea26813112d428c4a6: 2023-11-26 15:55:07,178 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:55:07,178 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-26 15:55:07,568 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family2/a6ed90aff8f443d9b8d42aaa2e7402b0 2023-11-26 15:55:07,572 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a6ed90aff8f443d9b8d42aaa2e7402b0 2023-11-26 15:55:07,573 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family1/38b8c67df4a04cebb7a6f973b29abe4b as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/38b8c67df4a04cebb7a6f973b29abe4b 2023-11-26 15:55:07,576 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38b8c67df4a04cebb7a6f973b29abe4b 2023-11-26 15:55:07,576 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/38b8c67df4a04cebb7a6f973b29abe4b, entries=3, sequenceid=24, filesize=5.0 K 2023-11-26 15:55:07,577 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family2/a6ed90aff8f443d9b8d42aaa2e7402b0 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/a6ed90aff8f443d9b8d42aaa2e7402b0 2023-11-26 15:55:07,581 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a6ed90aff8f443d9b8d42aaa2e7402b0 2023-11-26 15:55:07,581 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/a6ed90aff8f443d9b8d42aaa2e7402b0, entries=1, sequenceid=24, filesize=5.0 K 2023-11-26 15:55:07,582 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for dd287aba04977d5f4b3a261b02c79746 in 1266ms, sequenceid=24, compaction requested=true 2023-11-26 15:55:07,582 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dd287aba04977d5f4b3a261b02c79746: 2023-11-26 15:55:07,582 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:55:07,582 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-26 15:55:07,582 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-26 15:55:07,582 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:07,582 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-26 15:55:07,582 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-26 15:55:07,584 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:07,584 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:07,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:07,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:07,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:07,584 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:07,584 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:07,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:07,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:07,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:07,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:07,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:07,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-26 15:55:07,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55dc31c8[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:07,585 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-26 15:55:07,586 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:07,587 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:07,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:07,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:07,587 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-26 15:55:07,587 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-26 15:55:07,587 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:07,587 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:07,587 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:07,588 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:07,588 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-26 15:55:07,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:07,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:07,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:07,588 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:07,588 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-26 15:55:07,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:07,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:07,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:07,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:07,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:07,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:07,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:07,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:07,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-26 15:55:07,591 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-26 15:55:07,591 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:07,591 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:07,591 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-26 15:55:07,591 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:07,594 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:07,594 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:07,594 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:07,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:07,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:07,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:07,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:07,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:07,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:07,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:07,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:07,595 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:07,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:07,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:07,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:07,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:07,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:07,596 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:07,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:07,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-26 15:55:07,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:07,599 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:07,599 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:07,599 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:55:07,599 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:07,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:07,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-26 15:55:07,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:07,599 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:07,599 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-26 15:55:07,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-26 15:55:07,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:07,599 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:07,599 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:07,599 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:07,599 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-26 15:55:07,599 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:07,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:07,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:07,600 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-26 15:55:07,700 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:07,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:07,701 DEBUG [Listener at localhost/43645] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-26 15:55:07,702 DEBUG [Listener at localhost/43645] regionserver.HStore(1912): dd287aba04977d5f4b3a261b02c79746/family1 is initiating major compaction (all files) 2023-11-26 15:55:07,702 INFO [Listener at localhost/43645] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-26 15:55:07,702 INFO [Listener at localhost/43645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:55:07,702 INFO [Listener at localhost/43645] regionserver.HRegion(2259): Starting compaction of dd287aba04977d5f4b3a261b02c79746/family1 in testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:55:07,702 INFO [Listener at localhost/43645] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/47741ead1ae940b2a3fc6b01ddd532bb, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/878fdc9fd5214d9e901aca452f0b5369, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/b17df9b698254d84845aab04224498f4, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/646cfe52791142b4939f824adab394a1, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/38b8c67df4a04cebb7a6f973b29abe4b] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp, totalSize=26.7 K 2023-11-26 15:55:07,702 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 47741ead1ae940b2a3fc6b01ddd532bb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014097264 2023-11-26 15:55:07,703 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 878fdc9fd5214d9e901aca452f0b5369, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014099079 2023-11-26 15:55:07,703 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting b17df9b698254d84845aab04224498f4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014100895 2023-11-26 15:55:07,703 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 646cfe52791142b4939f824adab394a1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014102704 2023-11-26 15:55:07,704 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 38b8c67df4a04cebb7a6f973b29abe4b, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-26 15:55:07,716 INFO [Listener at localhost/43645] throttle.PressureAwareThroughputController(145): dd287aba04977d5f4b3a261b02c79746#family1#compaction#108 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:08,125 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231126e8493c2bb12d43d2a541f0b814a0de58_del 2023-11-26 15:55:08,125 INFO [Listener at localhost/43645] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231126e8493c2bb12d43d2a541f0b814a0de58_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126e8493c2bb12d43d2a541f0b814a0de58_del 2023-11-26 15:55:08,937 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5332c2e5cb1746f39cc3ecefd97ca647 2023-11-26 15:55:08,938 DEBUG [Listener at localhost/43645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family1/5332c2e5cb1746f39cc3ecefd97ca647 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/5332c2e5cb1746f39cc3ecefd97ca647 2023-11-26 15:55:08,941 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5332c2e5cb1746f39cc3ecefd97ca647 2023-11-26 15:55:08,942 INFO [Listener at localhost/43645] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in dd287aba04977d5f4b3a261b02c79746/family1 of dd287aba04977d5f4b3a261b02c79746 into 5332c2e5cb1746f39cc3ecefd97ca647(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-26 15:55:08,942 DEBUG [Listener at localhost/43645] regionserver.HRegion(2289): Compaction status journal for dd287aba04977d5f4b3a261b02c79746: 2023-11-26 15:55:08,943 DEBUG [Listener at localhost/43645] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-26 15:55:08,943 DEBUG [Listener at localhost/43645] regionserver.HStore(1912): dd287aba04977d5f4b3a261b02c79746/family2 is initiating major compaction (all files) 2023-11-26 15:55:08,943 INFO [Listener at localhost/43645] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-26 15:55:08,943 INFO [Listener at localhost/43645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:55:08,943 INFO [Listener at localhost/43645] regionserver.HRegion(2259): Starting compaction of dd287aba04977d5f4b3a261b02c79746/family2 in testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:55:08,943 INFO [Listener at localhost/43645] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/4018d6308c69481b80b6f546d1b9f244, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/ca383d22f31c49e79ff543bd09b71dba, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/fde91b6e09f84eea9754e2c4ddb510b5, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/f1440736d19a48dbadf1b913c334b692, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/a6ed90aff8f443d9b8d42aaa2e7402b0] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp, totalSize=25.4 K 2023-11-26 15:55:08,943 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 4018d6308c69481b80b6f546d1b9f244, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014097264 2023-11-26 15:55:08,944 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting ca383d22f31c49e79ff543bd09b71dba, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014099079 2023-11-26 15:55:08,944 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting fde91b6e09f84eea9754e2c4ddb510b5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014100895 2023-11-26 15:55:08,944 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting f1440736d19a48dbadf1b913c334b692, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014102704 2023-11-26 15:55:08,945 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting a6ed90aff8f443d9b8d42aaa2e7402b0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-26 15:55:08,946 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/47741ead1ae940b2a3fc6b01ddd532bb, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/878fdc9fd5214d9e901aca452f0b5369, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/b17df9b698254d84845aab04224498f4, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/646cfe52791142b4939f824adab394a1, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/38b8c67df4a04cebb7a6f973b29abe4b] to archive 2023-11-26 15:55:08,947 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:08,949 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/47741ead1ae940b2a3fc6b01ddd532bb to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/47741ead1ae940b2a3fc6b01ddd532bb 2023-11-26 15:55:08,950 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/878fdc9fd5214d9e901aca452f0b5369 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/878fdc9fd5214d9e901aca452f0b5369 2023-11-26 15:55:08,951 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/b17df9b698254d84845aab04224498f4 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/b17df9b698254d84845aab04224498f4 2023-11-26 15:55:08,953 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/646cfe52791142b4939f824adab394a1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/646cfe52791142b4939f824adab394a1 2023-11-26 15:55:08,954 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/38b8c67df4a04cebb7a6f973b29abe4b to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/38b8c67df4a04cebb7a6f973b29abe4b 2023-11-26 15:55:08,962 INFO [Listener at localhost/43645] throttle.PressureAwareThroughputController(145): dd287aba04977d5f4b3a261b02c79746#family2#compaction#109 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:09,370 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023112645d53a6b381c4bc88dc620d0473ec708_del 2023-11-26 15:55:09,370 INFO [Listener at localhost/43645] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112645d53a6b381c4bc88dc620d0473ec708_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112645d53a6b381c4bc88dc620d0473ec708_del 2023-11-26 15:55:10,184 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b2d73f59ed5f4ee1a7af40732bd925f1 2023-11-26 15:55:10,184 DEBUG [Listener at localhost/43645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family2/b2d73f59ed5f4ee1a7af40732bd925f1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/b2d73f59ed5f4ee1a7af40732bd925f1 2023-11-26 15:55:10,188 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b2d73f59ed5f4ee1a7af40732bd925f1 2023-11-26 15:55:10,189 INFO [Listener at localhost/43645] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in dd287aba04977d5f4b3a261b02c79746/family2 of dd287aba04977d5f4b3a261b02c79746 into b2d73f59ed5f4ee1a7af40732bd925f1(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-26 15:55:10,189 DEBUG [Listener at localhost/43645] regionserver.HRegion(2289): Compaction status journal for dd287aba04977d5f4b3a261b02c79746: 2023-11-26 15:55:10,190 DEBUG [Listener at localhost/43645] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-26 15:55:10,190 DEBUG [Listener at localhost/43645] regionserver.HStore(1912): 900c2d000cb588ea26813112d428c4a6/family1 is initiating major compaction (all files) 2023-11-26 15:55:10,190 INFO [Listener at localhost/43645] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-26 15:55:10,190 INFO [Listener at localhost/43645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:55:10,190 INFO [Listener at localhost/43645] regionserver.HRegion(2259): Starting compaction of 900c2d000cb588ea26813112d428c4a6/family1 in testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:55:10,190 INFO [Listener at localhost/43645] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/4aa05e8735e14d5fb85a30feb64b6842, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/21da28f4f1cb446b92af01b16ceb0784, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/a93aa2aec72947c38938f30dcd338726, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/1fe28b79aa0940e6b580460106e65974, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/2a5261fe3926480e8bb7bfa3ba9e9308] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp, totalSize=26.7 K 2023-11-26 15:55:10,190 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 4aa05e8735e14d5fb85a30feb64b6842, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014097265 2023-11-26 15:55:10,191 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 21da28f4f1cb446b92af01b16ceb0784, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014099079 2023-11-26 15:55:10,191 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting a93aa2aec72947c38938f30dcd338726, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014100895 2023-11-26 15:55:10,191 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 1fe28b79aa0940e6b580460106e65974, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014102704 2023-11-26 15:55:10,192 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 2a5261fe3926480e8bb7bfa3ba9e9308, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-26 15:55:10,202 INFO [Listener at localhost/43645] throttle.PressureAwareThroughputController(145): 900c2d000cb588ea26813112d428c4a6#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:10,214 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023112677fe3468074b4fca94855e60cc2fa358_del 2023-11-26 15:55:10,214 INFO [Listener at localhost/43645] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112677fe3468074b4fca94855e60cc2fa358_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112677fe3468074b4fca94855e60cc2fa358_del 2023-11-26 15:55:10,246 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/4018d6308c69481b80b6f546d1b9f244, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/ca383d22f31c49e79ff543bd09b71dba, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/fde91b6e09f84eea9754e2c4ddb510b5, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/f1440736d19a48dbadf1b913c334b692, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/a6ed90aff8f443d9b8d42aaa2e7402b0] to archive 2023-11-26 15:55:10,247 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:10,249 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/4018d6308c69481b80b6f546d1b9f244 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/4018d6308c69481b80b6f546d1b9f244 2023-11-26 15:55:10,250 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/ca383d22f31c49e79ff543bd09b71dba to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/ca383d22f31c49e79ff543bd09b71dba 2023-11-26 15:55:10,251 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/fde91b6e09f84eea9754e2c4ddb510b5 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/fde91b6e09f84eea9754e2c4ddb510b5 2023-11-26 15:55:10,252 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/f1440736d19a48dbadf1b913c334b692 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/f1440736d19a48dbadf1b913c334b692 2023-11-26 15:55:10,253 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/a6ed90aff8f443d9b8d42aaa2e7402b0 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/a6ed90aff8f443d9b8d42aaa2e7402b0 2023-11-26 15:55:11,031 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1e1ae943c98444a1b49e551d2979fb73 2023-11-26 15:55:11,032 DEBUG [Listener at localhost/43645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family1/1e1ae943c98444a1b49e551d2979fb73 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/1e1ae943c98444a1b49e551d2979fb73 2023-11-26 15:55:11,035 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1e1ae943c98444a1b49e551d2979fb73 2023-11-26 15:55:11,036 INFO [Listener at localhost/43645] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 900c2d000cb588ea26813112d428c4a6/family1 of 900c2d000cb588ea26813112d428c4a6 into 1e1ae943c98444a1b49e551d2979fb73(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:55:11,036 DEBUG [Listener at localhost/43645] regionserver.HRegion(2289): Compaction status journal for 900c2d000cb588ea26813112d428c4a6: 2023-11-26 15:55:11,036 DEBUG [Listener at localhost/43645] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-26 15:55:11,036 DEBUG [Listener at localhost/43645] regionserver.HStore(1912): 900c2d000cb588ea26813112d428c4a6/family2 is initiating major compaction (all files) 2023-11-26 15:55:11,036 INFO [Listener at localhost/43645] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-26 15:55:11,037 INFO [Listener at localhost/43645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:55:11,037 INFO [Listener at localhost/43645] regionserver.HRegion(2259): Starting compaction of 900c2d000cb588ea26813112d428c4a6/family2 in testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:55:11,037 INFO [Listener at localhost/43645] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/4e1ed16f3099408f9b236ea81463ad33, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/ae016fb6728f4cbeb72c54a92d72395f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/f0d0cc00a77e455cadab119cbdd6bc90, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/8894fcc417754593ad6289f843cc9dfc, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/8b41563b3e514d6f83952994e12f4fe0] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp, totalSize=25.4 K 2023-11-26 15:55:11,037 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 4e1ed16f3099408f9b236ea81463ad33, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014097265 2023-11-26 15:55:11,037 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting ae016fb6728f4cbeb72c54a92d72395f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014099079 2023-11-26 15:55:11,038 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting f0d0cc00a77e455cadab119cbdd6bc90, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014100895 2023-11-26 15:55:11,038 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 8894fcc417754593ad6289f843cc9dfc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014102704 2023-11-26 15:55:11,038 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 8b41563b3e514d6f83952994e12f4fe0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-26 15:55:11,047 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/4aa05e8735e14d5fb85a30feb64b6842, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/21da28f4f1cb446b92af01b16ceb0784, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/a93aa2aec72947c38938f30dcd338726, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/1fe28b79aa0940e6b580460106e65974, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/2a5261fe3926480e8bb7bfa3ba9e9308] to archive 2023-11-26 15:55:11,048 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:11,049 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/4aa05e8735e14d5fb85a30feb64b6842 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/4aa05e8735e14d5fb85a30feb64b6842 2023-11-26 15:55:11,051 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/21da28f4f1cb446b92af01b16ceb0784 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/21da28f4f1cb446b92af01b16ceb0784 2023-11-26 15:55:11,052 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/a93aa2aec72947c38938f30dcd338726 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/a93aa2aec72947c38938f30dcd338726 2023-11-26 15:55:11,053 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/1fe28b79aa0940e6b580460106e65974 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/1fe28b79aa0940e6b580460106e65974 2023-11-26 15:55:11,054 INFO [Listener at localhost/43645] throttle.PressureAwareThroughputController(145): 900c2d000cb588ea26813112d428c4a6#family2#compaction#111 average throughput is 0.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:11,055 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/2a5261fe3926480e8bb7bfa3ba9e9308 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/2a5261fe3926480e8bb7bfa3ba9e9308 2023-11-26 15:55:11,062 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311269658fccde8304ec2bfedda96987b3570_del 2023-11-26 15:55:11,062 INFO [Listener at localhost/43645] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311269658fccde8304ec2bfedda96987b3570_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311269658fccde8304ec2bfedda96987b3570_del 2023-11-26 15:55:11,875 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1c90156d895f4082bd0b335d754c23bd 2023-11-26 15:55:11,876 DEBUG [Listener at localhost/43645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family2/1c90156d895f4082bd0b335d754c23bd as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/1c90156d895f4082bd0b335d754c23bd 2023-11-26 15:55:11,879 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1c90156d895f4082bd0b335d754c23bd 2023-11-26 15:55:11,880 INFO [Listener at localhost/43645] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 900c2d000cb588ea26813112d428c4a6/family2 of 900c2d000cb588ea26813112d428c4a6 into 1c90156d895f4082bd0b335d754c23bd(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:55:11,880 DEBUG [Listener at localhost/43645] regionserver.HRegion(2289): Compaction status journal for 900c2d000cb588ea26813112d428c4a6: 2023-11-26 15:55:11,880 DEBUG [Listener at localhost/43645] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-26 15:55:11,881 DEBUG [Listener at localhost/43645] regionserver.HStore(1912): 1cc117e24a014df5815461dcd6bc9ce1/family1 is initiating major compaction (all files) 2023-11-26 15:55:11,881 INFO [Listener at localhost/43645] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-26 15:55:11,881 INFO [Listener at localhost/43645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:55:11,881 INFO [Listener at localhost/43645] regionserver.HRegion(2259): Starting compaction of 1cc117e24a014df5815461dcd6bc9ce1/family1 in testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:55:11,881 INFO [Listener at localhost/43645] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/68b01851f116456fb29a8a135104f863, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/2753710c7d794b5884b18c02f38e9bcd, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/081ad50692d243e28d9e522b92b508e8, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/28077643ac3d4174a87e2a86d0d4ce53, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/713cb9e1d7814bf08fe464a780645043] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp, totalSize=26.7 K 2023-11-26 15:55:11,881 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 68b01851f116456fb29a8a135104f863, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014097262 2023-11-26 15:55:11,882 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 2753710c7d794b5884b18c02f38e9bcd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014099079 2023-11-26 15:55:11,882 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 081ad50692d243e28d9e522b92b508e8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014100895 2023-11-26 15:55:11,882 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 28077643ac3d4174a87e2a86d0d4ce53, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014102703 2023-11-26 15:55:11,883 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 713cb9e1d7814bf08fe464a780645043, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-26 15:55:11,893 INFO [Listener at localhost/43645] throttle.PressureAwareThroughputController(145): 1cc117e24a014df5815461dcd6bc9ce1#family1#compaction#112 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:11,948 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/4e1ed16f3099408f9b236ea81463ad33, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/ae016fb6728f4cbeb72c54a92d72395f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/f0d0cc00a77e455cadab119cbdd6bc90, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/8894fcc417754593ad6289f843cc9dfc, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/8b41563b3e514d6f83952994e12f4fe0] to archive 2023-11-26 15:55:11,949 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:11,951 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/4e1ed16f3099408f9b236ea81463ad33 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/4e1ed16f3099408f9b236ea81463ad33 2023-11-26 15:55:11,952 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/ae016fb6728f4cbeb72c54a92d72395f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/ae016fb6728f4cbeb72c54a92d72395f 2023-11-26 15:55:11,953 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/f0d0cc00a77e455cadab119cbdd6bc90 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/f0d0cc00a77e455cadab119cbdd6bc90 2023-11-26 15:55:11,954 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/8894fcc417754593ad6289f843cc9dfc to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/8894fcc417754593ad6289f843cc9dfc 2023-11-26 15:55:11,955 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/8b41563b3e514d6f83952994e12f4fe0 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/8b41563b3e514d6f83952994e12f4fe0 2023-11-26 15:55:12,301 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311266809fcb05faf4802a33f66e34b409690_del 2023-11-26 15:55:12,301 INFO [Listener at localhost/43645] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311266809fcb05faf4802a33f66e34b409690_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311266809fcb05faf4802a33f66e34b409690_del 2023-11-26 15:55:13,116 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 766600613c564c84ad670c763f52f74a 2023-11-26 15:55:13,117 DEBUG [Listener at localhost/43645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family1/766600613c564c84ad670c763f52f74a as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/766600613c564c84ad670c763f52f74a 2023-11-26 15:55:13,121 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 766600613c564c84ad670c763f52f74a 2023-11-26 15:55:13,122 INFO [Listener at localhost/43645] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1cc117e24a014df5815461dcd6bc9ce1/family1 of 1cc117e24a014df5815461dcd6bc9ce1 into 766600613c564c84ad670c763f52f74a(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-26 15:55:13,122 DEBUG [Listener at localhost/43645] regionserver.HRegion(2289): Compaction status journal for 1cc117e24a014df5815461dcd6bc9ce1: 2023-11-26 15:55:13,122 DEBUG [Listener at localhost/43645] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-26 15:55:13,122 DEBUG [Listener at localhost/43645] regionserver.HStore(1912): 1cc117e24a014df5815461dcd6bc9ce1/family2 is initiating major compaction (all files) 2023-11-26 15:55:13,123 INFO [Listener at localhost/43645] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-26 15:55:13,123 INFO [Listener at localhost/43645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:55:13,124 INFO [Listener at localhost/43645] regionserver.HRegion(2259): Starting compaction of 1cc117e24a014df5815461dcd6bc9ce1/family2 in testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:55:13,124 INFO [Listener at localhost/43645] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/75f40a13c3774903aa3895831d86437c, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/346fe445f40d49e5acba25945590457f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/2e3094c168c0454ca21dfb7e9c4724cc, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/026fd04c221d45a0b392c3c766ac455e, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/64d10dffd0d54838905657b6d4c8ae71] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp, totalSize=25.4 K 2023-11-26 15:55:13,124 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 75f40a13c3774903aa3895831d86437c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014097262 2023-11-26 15:55:13,125 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 346fe445f40d49e5acba25945590457f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014099079 2023-11-26 15:55:13,125 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 2e3094c168c0454ca21dfb7e9c4724cc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014100895 2023-11-26 15:55:13,125 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 026fd04c221d45a0b392c3c766ac455e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014102703 2023-11-26 15:55:13,126 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 64d10dffd0d54838905657b6d4c8ae71, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-26 15:55:13,137 INFO [Listener at localhost/43645] throttle.PressureAwareThroughputController(145): 1cc117e24a014df5815461dcd6bc9ce1#family2#compaction#113 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:13,148 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/68b01851f116456fb29a8a135104f863, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/2753710c7d794b5884b18c02f38e9bcd, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/081ad50692d243e28d9e522b92b508e8, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/28077643ac3d4174a87e2a86d0d4ce53, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/713cb9e1d7814bf08fe464a780645043] to archive 2023-11-26 15:55:13,149 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:13,150 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/68b01851f116456fb29a8a135104f863 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/68b01851f116456fb29a8a135104f863 2023-11-26 15:55:13,152 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/2753710c7d794b5884b18c02f38e9bcd to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/2753710c7d794b5884b18c02f38e9bcd 2023-11-26 15:55:13,153 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/081ad50692d243e28d9e522b92b508e8 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/081ad50692d243e28d9e522b92b508e8 2023-11-26 15:55:13,154 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/28077643ac3d4174a87e2a86d0d4ce53 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/28077643ac3d4174a87e2a86d0d4ce53 2023-11-26 15:55:13,155 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/713cb9e1d7814bf08fe464a780645043 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/713cb9e1d7814bf08fe464a780645043 2023-11-26 15:55:13,552 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231126133d72b964f3477792288397149a0886_del 2023-11-26 15:55:13,552 INFO [Listener at localhost/43645] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231126133d72b964f3477792288397149a0886_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231126133d72b964f3477792288397149a0886_del 2023-11-26 15:55:13,966 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2af7e4186414fd382ba2575d297276c 2023-11-26 15:55:13,967 DEBUG [Listener at localhost/43645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family2/d2af7e4186414fd382ba2575d297276c as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/d2af7e4186414fd382ba2575d297276c 2023-11-26 15:55:13,970 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2af7e4186414fd382ba2575d297276c 2023-11-26 15:55:13,971 INFO [Listener at localhost/43645] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1cc117e24a014df5815461dcd6bc9ce1/family2 of 1cc117e24a014df5815461dcd6bc9ce1 into d2af7e4186414fd382ba2575d297276c(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:55:13,971 DEBUG [Listener at localhost/43645] regionserver.HRegion(2289): Compaction status journal for 1cc117e24a014df5815461dcd6bc9ce1: 2023-11-26 15:55:13,976 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:55:13,980 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:55:13,985 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:55:13,986 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:55:13,991 INFO [Listener at localhost/43645] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-26 15:55:14,022 INFO [Listener at localhost/43645] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-26 15:55:14,025 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311266809fcb05faf4802a33f66e34b409690_del 2023-11-26 15:55:14,028 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231126e8493c2bb12d43d2a541f0b814a0de58_del 2023-11-26 15:55:14,031 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023112677fe3468074b4fca94855e60cc2fa358_del 2023-11-26 15:55:14,031 INFO [Listener at localhost/43645] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-26 15:55:14,032 DEBUG [Listener at localhost/43645] zookeeper.ReadOnlyZKClient(139): Connect 0x577dcbf2 to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:55:14,036 DEBUG [Listener at localhost/43645] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e09180c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:55:14,036 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231126 for table='testCompactionWithHFileLink' and column='family1' 2023-11-26 15:55:14,036 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231126 for table='testCompactionWithHFileLink' and column='family1' 2023-11-26 15:55:14,036 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231126 for table='testCompactionWithHFileLink' and column='family1' 2023-11-26 15:55:14,047 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/75f40a13c3774903aa3895831d86437c, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/346fe445f40d49e5acba25945590457f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/2e3094c168c0454ca21dfb7e9c4724cc, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/026fd04c221d45a0b392c3c766ac455e, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/64d10dffd0d54838905657b6d4c8ae71] to archive 2023-11-26 15:55:14,047 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:14,049 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/75f40a13c3774903aa3895831d86437c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/75f40a13c3774903aa3895831d86437c 2023-11-26 15:55:14,050 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/346fe445f40d49e5acba25945590457f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/346fe445f40d49e5acba25945590457f 2023-11-26 15:55:14,052 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/2e3094c168c0454ca21dfb7e9c4724cc to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/2e3094c168c0454ca21dfb7e9c4724cc 2023-11-26 15:55:14,053 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/026fd04c221d45a0b392c3c766ac455e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/026fd04c221d45a0b392c3c766ac455e 2023-11-26 15:55:14,054 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/64d10dffd0d54838905657b6d4c8ae71 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/64d10dffd0d54838905657b6d4c8ae71 2023-11-26 15:55:14,515 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126570023e1f964459586723bf638c35c75 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231126570023e1f964459586723bf638c35c75 2023-11-26 15:55:14,516 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231126 table='testCompactionWithHFileLink' column='family1' 2023-11-26 15:55:14,529 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:55:14,532 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:55:14,539 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-26 15:55:14,541 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-26 15:55:14,549 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231126/family1/450f7599ac02456a81b085b481dd3ce5 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-26 15:55:14,549 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231126/family1/450f7599ac02456a81b085b481dd3ce5}] 2023-11-26 15:55:14,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231126/family1/450f7599ac02456a81b085b481dd3ce5 for inclusion in 900c2d000cb588ea26813112d428c4a6/family1 2023-11-26 15:55:14,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-26 15:55:14,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-26 15:55:14,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for 900c2d000cb588ea26813112d428c4a6: 2023-11-26 15:55:14,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231126/family1/450f7599ac02456a81b085b481dd3ce5 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__alhm7eps2suuvptghfh4odnrhnlal4qmrtnfsdnodq3nq1eumeb2n5nvbdjo99bi/family1/450f7599ac02456a81b085b481dd3ce5 2023-11-26 15:55:14,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__alhm7eps2suuvptghfh4odnrhnlal4qmrtnfsdnodq3nq1eumeb2n5nvbdjo99bi/family1/450f7599ac02456a81b085b481dd3ce5 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/860a9b5d842c4e4985b59af0c14143cd_SeqId_29_ 2023-11-26 15:55:14,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__alhm7eps2suuvptghfh4odnrhnlal4qmrtnfsdnodq3nq1eumeb2n5nvbdjo99bi/family1/450f7599ac02456a81b085b481dd3ce5 into 900c2d000cb588ea26813112d428c4a6/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/860a9b5d842c4e4985b59af0c14143cd_SeqId_29_ - updating store file list. 2023-11-26 15:55:14,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/860a9b5d842c4e4985b59af0c14143cd_SeqId_29_ into 900c2d000cb588ea26813112d428c4a6/family1 2023-11-26 15:55:14,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__alhm7eps2suuvptghfh4odnrhnlal4qmrtnfsdnodq3nq1eumeb2n5nvbdjo99bi/family1/450f7599ac02456a81b085b481dd3ce5 into 900c2d000cb588ea26813112d428c4a6/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/860a9b5d842c4e4985b59af0c14143cd_SeqId_29_) 2023-11-26 15:55:14,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__alhm7eps2suuvptghfh4odnrhnlal4qmrtnfsdnodq3nq1eumeb2n5nvbdjo99bi/family1/450f7599ac02456a81b085b481dd3ce5 2023-11-26 15:55:14,563 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231126 table='testCompactionWithHFileLink' column='family1' 2023-11-26 15:55:14,563 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:14,564 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231126249a37657ef94cb7b3447b02179b0f32 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231126249a37657ef94cb7b3447b02179b0f32 2023-11-26 15:55:14,565 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311262a00b7a0281d4b98a765c16de254c7d3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311262a00b7a0281d4b98a765c16de254c7d3 2023-11-26 15:55:14,566 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231126e6381db945a24f54844a145429b91d6a to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231126e6381db945a24f54844a145429b91d6a 2023-11-26 15:55:14,567 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231126f11df26d44774221847b9915bc03112c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231126f11df26d44774221847b9915bc03112c 2023-11-26 15:55:14,567 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-26 15:55:14,567 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231126' 2023-11-26 15:55:14,567 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231126 for table='testCompactionWithHFileLink' and column='family1' 2023-11-26 15:55:14,903 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231126578bbbef746e4e93bf3aca784c0a420d to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231126578bbbef746e4e93bf3aca784c0a420d 2023-11-26 15:55:14,903 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231126 table='testCompactionWithHFileLink' column='family1' 2023-11-26 15:55:14,918 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231126d48a800e038d4074a5dce3baf1542eb5 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126d48a800e038d4074a5dce3baf1542eb5 2023-11-26 15:55:14,919 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231126 table='testCompactionWithHFileLink' column='family1' 2023-11-26 15:55:14,934 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231126/family1/1b0a8bbd2a2846f3a02e0a805fc0cd91 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-26 15:55:14,936 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231126/family1/1b0a8bbd2a2846f3a02e0a805fc0cd91}] 2023-11-26 15:55:14,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231126/family1/1b0a8bbd2a2846f3a02e0a805fc0cd91 for inclusion in 1cc117e24a014df5815461dcd6bc9ce1/family1 2023-11-26 15:55:14,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-26 15:55:14,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last=1 2023-11-26 15:55:14,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for 1cc117e24a014df5815461dcd6bc9ce1: 2023-11-26 15:55:14,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231126/family1/1b0a8bbd2a2846f3a02e0a805fc0cd91 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__l65dv6lshpe40hh3gg0aq42o7ocogo4jloth06fmlsrm73t48dgo9fnr126u780f/family1/1b0a8bbd2a2846f3a02e0a805fc0cd91 2023-11-26 15:55:14,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__l65dv6lshpe40hh3gg0aq42o7ocogo4jloth06fmlsrm73t48dgo9fnr126u780f/family1/1b0a8bbd2a2846f3a02e0a805fc0cd91 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/78bc969c67a74fcca765d539c1ca49c4_SeqId_29_ 2023-11-26 15:55:14,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__l65dv6lshpe40hh3gg0aq42o7ocogo4jloth06fmlsrm73t48dgo9fnr126u780f/family1/1b0a8bbd2a2846f3a02e0a805fc0cd91 into 1cc117e24a014df5815461dcd6bc9ce1/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/78bc969c67a74fcca765d539c1ca49c4_SeqId_29_ - updating store file list. 2023-11-26 15:55:14,947 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231126/family1/622cb52d0dff42e3bf5f189c8a85bb35 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-26 15:55:14,948 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231126/family1/622cb52d0dff42e3bf5f189c8a85bb35}] 2023-11-26 15:55:14,950 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231126/family1/622cb52d0dff42e3bf5f189c8a85bb35 for inclusion in dd287aba04977d5f4b3a261b02c79746/family1 2023-11-26 15:55:14,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/78bc969c67a74fcca765d539c1ca49c4_SeqId_29_ into 1cc117e24a014df5815461dcd6bc9ce1/family1 2023-11-26 15:55:14,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__l65dv6lshpe40hh3gg0aq42o7ocogo4jloth06fmlsrm73t48dgo9fnr126u780f/family1/1b0a8bbd2a2846f3a02e0a805fc0cd91 into 1cc117e24a014df5815461dcd6bc9ce1/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/78bc969c67a74fcca765d539c1ca49c4_SeqId_29_) 2023-11-26 15:55:14,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__l65dv6lshpe40hh3gg0aq42o7ocogo4jloth06fmlsrm73t48dgo9fnr126u780f/family1/1b0a8bbd2a2846f3a02e0a805fc0cd91 2023-11-26 15:55:14,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-26 15:55:14,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-26 15:55:14,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for dd287aba04977d5f4b3a261b02c79746: 2023-11-26 15:55:14,953 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231126 table='testCompactionWithHFileLink' column='family1' 2023-11-26 15:55:14,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231126/family1/622cb52d0dff42e3bf5f189c8a85bb35 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__of4ubrtn575m1acdk66is0tus3idrtli7p3smecvq9kph0qvbrjkdelf5nrmaiie/family1/622cb52d0dff42e3bf5f189c8a85bb35 2023-11-26 15:55:14,954 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:14,956 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231126123260774e834fc6913eb37fd795185d to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231126123260774e834fc6913eb37fd795185d 2023-11-26 15:55:14,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__of4ubrtn575m1acdk66is0tus3idrtli7p3smecvq9kph0qvbrjkdelf5nrmaiie/family1/622cb52d0dff42e3bf5f189c8a85bb35 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/5ede2958791641bda0ad76c4c269b645_SeqId_29_ 2023-11-26 15:55:14,956 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__of4ubrtn575m1acdk66is0tus3idrtli7p3smecvq9kph0qvbrjkdelf5nrmaiie/family1/622cb52d0dff42e3bf5f189c8a85bb35 into dd287aba04977d5f4b3a261b02c79746/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/5ede2958791641bda0ad76c4c269b645_SeqId_29_ - updating store file list. 2023-11-26 15:55:14,957 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112626244e342f2148cc85bd213afba54445 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112626244e342f2148cc85bd213afba54445 2023-11-26 15:55:14,958 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311262aa1b154e66842c99a229dce9c76af5e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311262aa1b154e66842c99a229dce9c76af5e 2023-11-26 15:55:14,959 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231126c3828775b0b84bb2b7b1033d80fa6517 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231126c3828775b0b84bb2b7b1033d80fa6517 2023-11-26 15:55:14,959 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-26 15:55:14,959 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231126' 2023-11-26 15:55:14,959 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231126 for table='testCompactionWithHFileLink' and column='family1' 2023-11-26 15:55:14,959 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/5ede2958791641bda0ad76c4c269b645_SeqId_29_ into dd287aba04977d5f4b3a261b02c79746/family1 2023-11-26 15:55:14,959 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__of4ubrtn575m1acdk66is0tus3idrtli7p3smecvq9kph0qvbrjkdelf5nrmaiie/family1/622cb52d0dff42e3bf5f189c8a85bb35 into dd287aba04977d5f4b3a261b02c79746/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/5ede2958791641bda0ad76c4c269b645_SeqId_29_) 2023-11-26 15:55:14,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__of4ubrtn575m1acdk66is0tus3idrtli7p3smecvq9kph0qvbrjkdelf5nrmaiie/family1/622cb52d0dff42e3bf5f189c8a85bb35 2023-11-26 15:55:14,961 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231126 table='testCompactionWithHFileLink' column='family1' 2023-11-26 15:55:14,962 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:14,963 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311269e01de33b3da4b5c9c6a706aa82213c6 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311269e01de33b3da4b5c9c6a706aa82213c6 2023-11-26 15:55:14,964 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126b68fac10445849b8bdd52d3cdac0bf27 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126b68fac10445849b8bdd52d3cdac0bf27 2023-11-26 15:55:14,965 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126d7332dc0e7af47ca941c153160b7f096 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126d7332dc0e7af47ca941c153160b7f096 2023-11-26 15:55:14,965 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126d85d0ccc0670444e8124edf44cdfbeee to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126d85d0ccc0670444e8124edf44cdfbeee 2023-11-26 15:55:14,965 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-26 15:55:14,965 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231126' 2023-11-26 15:55:14,966 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231126 for table='testCompactionWithHFileLink' and column='family1' 2023-11-26 15:55:14,966 INFO [Listener at localhost/43645] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-26 15:55:14,966 INFO [Listener at localhost/43645] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-11-26 15:55:14,966 INFO [Listener at localhost/43645] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311266809fcb05faf4802a33f66e34b409690_del] 2023-11-26 15:55:14,966 DEBUG [Listener at localhost/43645] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:14,967 DEBUG [Listener at localhost/43645] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311266809fcb05faf4802a33f66e34b409690_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311266809fcb05faf4802a33f66e34b409690_del 2023-11-26 15:55:14,967 INFO [Listener at localhost/43645] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-26 15:55:14,967 INFO [Listener at localhost/43645] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126e8493c2bb12d43d2a541f0b814a0de58_del] 2023-11-26 15:55:14,968 DEBUG [Listener at localhost/43645] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:14,969 DEBUG [Listener at localhost/43645] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126e8493c2bb12d43d2a541f0b814a0de58_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126e8493c2bb12d43d2a541f0b814a0de58_del 2023-11-26 15:55:14,969 INFO [Listener at localhost/43645] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-26 15:55:14,969 INFO [Listener at localhost/43645] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112677fe3468074b4fca94855e60cc2fa358_del] 2023-11-26 15:55:14,969 DEBUG [Listener at localhost/43645] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:14,970 DEBUG [Listener at localhost/43645] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112677fe3468074b4fca94855e60cc2fa358_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023112677fe3468074b4fca94855e60cc2fa358_del 2023-11-26 15:55:14,970 INFO [Listener at localhost/43645] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-26 15:55:14,973 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:55:14,975 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:55:14,978 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:55:14,979 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:55:14,987 INFO [Listener at localhost/43645] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-11-26 15:55:14,987 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-11-26 15:55:14,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-11-26 15:55:14,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-26 15:55:14,990 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014114990"}]},"ts":"1701014114990"} 2023-11-26 15:55:14,991 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-11-26 15:55:14,993 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-11-26 15:55:14,994 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1cc117e24a014df5815461dcd6bc9ce1, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dd287aba04977d5f4b3a261b02c79746, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=900c2d000cb588ea26813112d428c4a6, UNASSIGN}] 2023-11-26 15:55:14,995 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dd287aba04977d5f4b3a261b02c79746, UNASSIGN 2023-11-26 15:55:14,995 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1cc117e24a014df5815461dcd6bc9ce1, UNASSIGN 2023-11-26 15:55:14,996 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=900c2d000cb588ea26813112d428c4a6, UNASSIGN 2023-11-26 15:55:14,996 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=dd287aba04977d5f4b3a261b02c79746, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:14,996 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=1cc117e24a014df5815461dcd6bc9ce1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:14,996 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701014114996"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014114996"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014114996"}]},"ts":"1701014114996"} 2023-11-26 15:55:14,996 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=900c2d000cb588ea26813112d428c4a6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:14,996 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701014114996"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014114996"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014114996"}]},"ts":"1701014114996"} 2023-11-26 15:55:14,996 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701014114996"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014114996"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014114996"}]},"ts":"1701014114996"} 2023-11-26 15:55:14,998 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure dd287aba04977d5f4b3a261b02c79746, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:55:14,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure 1cc117e24a014df5815461dcd6bc9ce1, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:55:15,000 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure 900c2d000cb588ea26813112d428c4a6, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:55:15,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-26 15:55:15,149 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:15,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:55:15,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dd287aba04977d5f4b3a261b02c79746, disabling compactions & flushes 2023-11-26 15:55:15,150 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:55:15,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:55:15,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. after waiting 0 ms 2023-11-26 15:55:15,150 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:55:15,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-26 15:55:15,155 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:55:15,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dd287aba04977d5f4b3a261b02c79746: 2023-11-26 15:55:15,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:55:15,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:55:15,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1cc117e24a014df5815461dcd6bc9ce1, disabling compactions & flushes 2023-11-26 15:55:15,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:55:15,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:55:15,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. after waiting 0 ms 2023-11-26 15:55:15,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:55:15,157 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=dd287aba04977d5f4b3a261b02c79746, regionState=CLOSED 2023-11-26 15:55:15,157 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701014115157"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014115157"}]},"ts":"1701014115157"} 2023-11-26 15:55:15,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=92, resume processing ppid=90 2023-11-26 15:55:15,160 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure dd287aba04977d5f4b3a261b02c79746, server=jenkins-hbase4.apache.org,41861,1701014000937 in 161 msec 2023-11-26 15:55:15,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-26 15:55:15,161 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dd287aba04977d5f4b3a261b02c79746, UNASSIGN in 166 msec 2023-11-26 15:55:15,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:55:15,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1cc117e24a014df5815461dcd6bc9ce1: 2023-11-26 15:55:15,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:55:15,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 900c2d000cb588ea26813112d428c4a6 2023-11-26 15:55:15,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 900c2d000cb588ea26813112d428c4a6, disabling compactions & flushes 2023-11-26 15:55:15,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:55:15,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:55:15,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. after waiting 0 ms 2023-11-26 15:55:15,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:55:15,163 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=1cc117e24a014df5815461dcd6bc9ce1, regionState=CLOSED 2023-11-26 15:55:15,163 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701014115163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014115163"}]},"ts":"1701014115163"} 2023-11-26 15:55:15,166 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=93, resume processing ppid=89 2023-11-26 15:55:15,166 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure 1cc117e24a014df5815461dcd6bc9ce1, server=jenkins-hbase4.apache.org,41861,1701014000937 in 167 msec 2023-11-26 15:55:15,167 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1cc117e24a014df5815461dcd6bc9ce1, UNASSIGN in 172 msec 2023-11-26 15:55:15,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-26 15:55:15,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:55:15,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 900c2d000cb588ea26813112d428c4a6: 2023-11-26 15:55:15,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 900c2d000cb588ea26813112d428c4a6 2023-11-26 15:55:15,170 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=900c2d000cb588ea26813112d428c4a6, regionState=CLOSED 2023-11-26 15:55:15,170 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701014115170"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014115170"}]},"ts":"1701014115170"} 2023-11-26 15:55:15,171 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=94, resume processing ppid=91 2023-11-26 15:55:15,172 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure 900c2d000cb588ea26813112d428c4a6, server=jenkins-hbase4.apache.org,41861,1701014000937 in 172 msec 2023-11-26 15:55:15,172 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=91, resume processing ppid=88 2023-11-26 15:55:15,173 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=900c2d000cb588ea26813112d428c4a6, UNASSIGN in 178 msec 2023-11-26 15:55:15,173 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014115173"}]},"ts":"1701014115173"} 2023-11-26 15:55:15,174 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-11-26 15:55:15,175 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-11-26 15:55:15,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 189 msec 2023-11-26 15:55:15,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-26 15:55:15,292 INFO [Listener at localhost/43645] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-11-26 15:55:15,303 INFO [Listener at localhost/43645] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1701014104110-1701014115303 2023-11-26 15:55:15,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1701014104110-1701014115303 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-26 15:55:15,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1701014115303 (current time:1701014115303). 2023-11-26 15:55:15,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-26 15:55:15,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] zookeeper.ReadOnlyZKClient(139): Connect 0x775e5770 to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:55:15,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6122b8ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:55:15,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:55:15,313 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:55:15,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x775e5770 to 127.0.0.1:58210 2023-11-26 15:55:15,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:55:15,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-26 15:55:15,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1701014104110-1701014115303 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-26 15:55:15,317 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.hbase-snapshot, current working dir path: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1701014104110-1701014115303 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-26 15:55:15,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-26 15:55:15,319 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-26 15:55:15,319 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1701014715319 2023-11-26 15:55:15,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1701014104110-1701014115303 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-26 15:55:15,319 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1701014104110-1701014115303 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-26 15:55:15,320 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1701014104110-1701014115303 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:15,320 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-26 15:55:15,420 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-26 15:55:15,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1701014104110-1701014115303 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-26 15:55:15,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1701014104110-1701014115303 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-26 15:55:15,421 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-26 15:55:15,621 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-26 15:55:15,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1701014104110-1701014115303 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-26 15:55:15,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1701014104110-1701014115303 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-26 15:55:15,623 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-26 15:55:15,726 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1701014104110-1701014115303 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-11-26 15:55:15,727 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-26 15:55:15,727 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-26 15:55:15,727 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-26 15:55:15,727 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-26 15:55:15,728 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-26 15:55:15,727 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-26 15:55:15,727 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-26 15:55:15,728 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-26 15:55:15,731 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/5332c2e5cb1746f39cc3ecefd97ca647, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/5ede2958791641bda0ad76c4c269b645_SeqId_29_] hfiles 2023-11-26 15:55:15,731 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/766600613c564c84ad670c763f52f74a, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/78bc969c67a74fcca765d539c1ca49c4_SeqId_29_] hfiles 2023-11-26 15:55:15,731 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/5332c2e5cb1746f39cc3ecefd97ca647 2023-11-26 15:55:15,731 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/1e1ae943c98444a1b49e551d2979fb73, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/860a9b5d842c4e4985b59af0c14143cd_SeqId_29_] hfiles 2023-11-26 15:55:15,731 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/766600613c564c84ad670c763f52f74a 2023-11-26 15:55:15,731 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/1e1ae943c98444a1b49e551d2979fb73 2023-11-26 15:55:15,731 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/5ede2958791641bda0ad76c4c269b645_SeqId_29_ 2023-11-26 15:55:15,731 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126d48a800e038d4074a5dce3baf1542eb5, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231126570023e1f964459586723bf638c35c75, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231126578bbbef746e4e93bf3aca784c0a420d] hfiles 2023-11-26 15:55:15,731 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/860a9b5d842c4e4985b59af0c14143cd_SeqId_29_ 2023-11-26 15:55:15,731 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/78bc969c67a74fcca765d539c1ca49c4_SeqId_29_ 2023-11-26 15:55:15,731 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126d48a800e038d4074a5dce3baf1542eb5 2023-11-26 15:55:15,732 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231126570023e1f964459586723bf638c35c75 2023-11-26 15:55:15,732 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231126578bbbef746e4e93bf3aca784c0a420d 2023-11-26 15:55:15,732 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/b2d73f59ed5f4ee1a7af40732bd925f1] hfiles 2023-11-26 15:55:15,732 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/1c90156d895f4082bd0b335d754c23bd] hfiles 2023-11-26 15:55:15,733 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/d2af7e4186414fd382ba2575d297276c] hfiles 2023-11-26 15:55:15,733 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/b2d73f59ed5f4ee1a7af40732bd925f1 2023-11-26 15:55:15,733 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/d2af7e4186414fd382ba2575d297276c 2023-11-26 15:55:15,733 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/1c90156d895f4082bd0b335d754c23bd 2023-11-26 15:55:15,745 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311262b6a92aed53e4f969a711b9777cad8e9, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112642a886bb2ba34c1196639724b4352a7f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112645d53a6b381c4bc88dc620d0473ec708_del, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311264eaf9751c4ee402dbcb5bfa22d520f29, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231126789ff6fb1e6d496e89016bed196e7e0d, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311266a7d047d3d674609810e7ffd826eb3fc, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231126944bc4f460684b31b4941a4538813a38, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311269658fccde8304ec2bfedda96987b3570_del, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311269c1dce9ee81b4eff8a281c4f33f2311a, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231126e80130657a9f4fe3b4d13d20f6e3668f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231126133d72b964f3477792288397149a0886_del, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112622c3dae8f3344fc593443697473b1c1a, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311264ca0d257509645bbb3ce8e0903f901da, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231126b2366e528a694d43904b1d15abc11f8e, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231126d799bcec843046bcac68dc9df5188195] hfiles 2023-11-26 15:55:15,745 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311262b6a92aed53e4f969a711b9777cad8e9 2023-11-26 15:55:15,745 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112642a886bb2ba34c1196639724b4352a7f 2023-11-26 15:55:15,745 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112645d53a6b381c4bc88dc620d0473ec708_del 2023-11-26 15:55:15,746 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311264eaf9751c4ee402dbcb5bfa22d520f29 2023-11-26 15:55:15,746 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231126789ff6fb1e6d496e89016bed196e7e0d 2023-11-26 15:55:15,746 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311266a7d047d3d674609810e7ffd826eb3fc 2023-11-26 15:55:15,746 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231126944bc4f460684b31b4941a4538813a38 2023-11-26 15:55:15,746 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311269658fccde8304ec2bfedda96987b3570_del 2023-11-26 15:55:15,746 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311269c1dce9ee81b4eff8a281c4f33f2311a 2023-11-26 15:55:15,746 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231126e80130657a9f4fe3b4d13d20f6e3668f 2023-11-26 15:55:15,746 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231126133d72b964f3477792288397149a0886_del 2023-11-26 15:55:15,746 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023112622c3dae8f3344fc593443697473b1c1a 2023-11-26 15:55:15,746 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311264ca0d257509645bbb3ce8e0903f901da 2023-11-26 15:55:15,746 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231126b2366e528a694d43904b1d15abc11f8e 2023-11-26 15:55:15,746 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231126d799bcec843046bcac68dc9df5188195 2023-11-26 15:55:15,923 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-26 15:55:15,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1701014104110-1701014115303 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-26 15:55:15,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1701014104110-1701014115303 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-26 15:55:15,924 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-26 15:55:16,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1701014104110-1701014115303 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-11-26 15:55:16,152 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1701014104110-1701014115303 2023-11-26 15:55:16,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1701014104110-1701014115303 2023-11-26 15:55:16,424 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-26 15:55:16,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1701014104110-1701014115303 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-26 15:55:16,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1701014104110-1701014115303 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-26 15:55:16,425 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-26 15:55:16,575 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1701014104110-1701014115303 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.hbase-snapshot/hbase-failsafe-snaptb-1701014104110-1701014115303 2023-11-26 15:55:16,576 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1701014104110-1701014115303 of table testCompactionWithHFileLink completed 2023-11-26 15:55:16,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1701014104110-1701014115303 2023-11-26 15:55:16,576 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1701014104110-1701014115303 2023-11-26 15:55:16,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1701014104110-1701014115303 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1701014115320Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1701014104110-1701014115303 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1701014115726 (+406 ms)Consolidate snapshot: hbase-failsafe-snaptb-1701014104110-1701014115303 at 1701014116152 (+426 ms)Loading Region manifests for hbase-failsafe-snaptb-1701014104110-1701014115303 at 1701014116152Writing data manifest for hbase-failsafe-snaptb-1701014104110-1701014115303 at 1701014116155 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1701014104110-1701014115303 at 1701014116562 (+407 ms)Snapshot hbase-failsafe-snaptb-1701014104110-1701014115303 of table testCompactionWithHFileLink completed at 1701014116576 (+14 ms) 2023-11-26 15:55:16,578 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-26 15:55:16,579 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2600 sec 2023-11-26 15:55:17,425 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-26 15:55:17,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1701014104110-1701014115303 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-26 15:55:17,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1701014104110-1701014115303 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-26 15:55:17,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1701014104110" table: "testCompactionWithHFileLink" creation_time: 1701014104120 type: FLUSH version: 2 ttl: 0 ) 2023-11-26 15:55:17,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1701014104110 as table=testCompactionWithHFileLink 2023-11-26 15:55:17,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-26 15:55:17,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-26 15:55:17,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-26 15:55:17,882 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-26 15:55:17,883 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-26 15:55:17,883 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-26 15:55:17,884 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1701014104110 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-26 15:55:17,890 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1701014104110" table: "testCompactionWithHFileLink" creation_time: 1701014104120 type: FLUSH version: 2 ttl: 0 2023-11-26 15:55:17,891 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink 2023-11-26 15:55:17,896 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-11-26 15:55:17,900 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231126570023e1f964459586723bf638c35c75 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231126570023e1f964459586723bf638c35c75 2023-11-26 15:55:17,901 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231126578bbbef746e4e93bf3aca784c0a420d to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231126578bbbef746e4e93bf3aca784c0a420d 2023-11-26 15:55:17,903 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126d48a800e038d4074a5dce3baf1542eb5 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126d48a800e038d4074a5dce3baf1542eb5 2023-11-26 15:55:17,903 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202311269e01de33b3da4b5c9c6a706aa82213c6 of snapshot=snaptb-1701014104110 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-26 15:55:17,907 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231126b68fac10445849b8bdd52d3cdac0bf27 of snapshot=snaptb-1701014104110 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-26 15:55:17,910 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231126d7332dc0e7af47ca941c153160b7f096 of snapshot=snaptb-1701014104110 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-26 15:55:17,913 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231126d85d0ccc0670444e8124edf44cdfbeee of snapshot=snaptb-1701014104110 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-26 15:55:17,916 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231126249a37657ef94cb7b3447b02179b0f32 of snapshot=snaptb-1701014104110 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-26 15:55:17,919 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202311262a00b7a0281d4b98a765c16de254c7d3 of snapshot=snaptb-1701014104110 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-26 15:55:17,922 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231126e6381db945a24f54844a145429b91d6a of snapshot=snaptb-1701014104110 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-26 15:55:17,925 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231126f11df26d44774221847b9915bc03112c of snapshot=snaptb-1701014104110 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-26 15:55:17,928 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231126123260774e834fc6913eb37fd795185d of snapshot=snaptb-1701014104110 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-26 15:55:17,931 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023112626244e342f2148cc85bd213afba54445 of snapshot=snaptb-1701014104110 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-26 15:55:17,934 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311262aa1b154e66842c99a229dce9c76af5e of snapshot=snaptb-1701014104110 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-26 15:55:17,937 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231126c3828775b0b84bb2b7b1033d80fa6517 of snapshot=snaptb-1701014104110 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-26 15:55:17,942 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112645d53a6b381c4bc88dc620d0473ec708_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023112645d53a6b381c4bc88dc620d0473ec708_del 2023-11-26 15:55:17,943 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231126133d72b964f3477792288397149a0886_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231126133d72b964f3477792288397149a0886_del 2023-11-26 15:55:17,944 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311269658fccde8304ec2bfedda96987b3570_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311269658fccde8304ec2bfedda96987b3570_del 2023-11-26 15:55:17,945 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:55:17,945 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 900c2d000cb588ea26813112d428c4a6 2023-11-26 15:55:17,945 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:55:17,950 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/766600613c564c84ad670c763f52f74a to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/766600613c564c84ad670c763f52f74a 2023-11-26 15:55:17,956 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/1e1ae943c98444a1b49e551d2979fb73 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/1e1ae943c98444a1b49e551d2979fb73 2023-11-26 15:55:17,956 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/5332c2e5cb1746f39cc3ecefd97ca647 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/5332c2e5cb1746f39cc3ecefd97ca647 2023-11-26 15:55:17,957 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/78bc969c67a74fcca765d539c1ca49c4_SeqId_29_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/78bc969c67a74fcca765d539c1ca49c4_SeqId_29_ 2023-11-26 15:55:17,957 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 68b01851f116456fb29a8a135104f863 of snapshot=snaptb-1701014104110 to region=1cc117e24a014df5815461dcd6bc9ce1 table=testCompactionWithHFileLink 2023-11-26 15:55:17,958 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/860a9b5d842c4e4985b59af0c14143cd_SeqId_29_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/860a9b5d842c4e4985b59af0c14143cd_SeqId_29_ 2023-11-26 15:55:17,958 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/5ede2958791641bda0ad76c4c269b645_SeqId_29_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/5ede2958791641bda0ad76c4c269b645_SeqId_29_ 2023-11-26 15:55:17,958 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 47741ead1ae940b2a3fc6b01ddd532bb of snapshot=snaptb-1701014104110 to region=dd287aba04977d5f4b3a261b02c79746 table=testCompactionWithHFileLink 2023-11-26 15:55:17,958 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4aa05e8735e14d5fb85a30feb64b6842 of snapshot=snaptb-1701014104110 to region=900c2d000cb588ea26813112d428c4a6 table=testCompactionWithHFileLink 2023-11-26 15:55:17,970 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2753710c7d794b5884b18c02f38e9bcd of snapshot=snaptb-1701014104110 to region=1cc117e24a014df5815461dcd6bc9ce1 table=testCompactionWithHFileLink 2023-11-26 15:55:17,971 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 878fdc9fd5214d9e901aca452f0b5369 of snapshot=snaptb-1701014104110 to region=dd287aba04977d5f4b3a261b02c79746 table=testCompactionWithHFileLink 2023-11-26 15:55:17,975 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 081ad50692d243e28d9e522b92b508e8 of snapshot=snaptb-1701014104110 to region=1cc117e24a014df5815461dcd6bc9ce1 table=testCompactionWithHFileLink 2023-11-26 15:55:17,975 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b17df9b698254d84845aab04224498f4 of snapshot=snaptb-1701014104110 to region=dd287aba04977d5f4b3a261b02c79746 table=testCompactionWithHFileLink 2023-11-26 15:55:17,978 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 21da28f4f1cb446b92af01b16ceb0784 of snapshot=snaptb-1701014104110 to region=900c2d000cb588ea26813112d428c4a6 table=testCompactionWithHFileLink 2023-11-26 15:55:17,986 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 28077643ac3d4174a87e2a86d0d4ce53 of snapshot=snaptb-1701014104110 to region=1cc117e24a014df5815461dcd6bc9ce1 table=testCompactionWithHFileLink 2023-11-26 15:55:17,986 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 646cfe52791142b4939f824adab394a1 of snapshot=snaptb-1701014104110 to region=dd287aba04977d5f4b3a261b02c79746 table=testCompactionWithHFileLink 2023-11-26 15:55:17,988 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a93aa2aec72947c38938f30dcd338726 of snapshot=snaptb-1701014104110 to region=900c2d000cb588ea26813112d428c4a6 table=testCompactionWithHFileLink 2023-11-26 15:55:17,991 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/d2af7e4186414fd382ba2575d297276c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/d2af7e4186414fd382ba2575d297276c 2023-11-26 15:55:17,991 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 75f40a13c3774903aa3895831d86437c of snapshot=snaptb-1701014104110 to region=1cc117e24a014df5815461dcd6bc9ce1 table=testCompactionWithHFileLink 2023-11-26 15:55:17,991 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1fe28b79aa0940e6b580460106e65974 of snapshot=snaptb-1701014104110 to region=900c2d000cb588ea26813112d428c4a6 table=testCompactionWithHFileLink 2023-11-26 15:55:17,992 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/b2d73f59ed5f4ee1a7af40732bd925f1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/b2d73f59ed5f4ee1a7af40732bd925f1 2023-11-26 15:55:17,992 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4018d6308c69481b80b6f546d1b9f244 of snapshot=snaptb-1701014104110 to region=dd287aba04977d5f4b3a261b02c79746 table=testCompactionWithHFileLink 2023-11-26 15:55:17,995 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 346fe445f40d49e5acba25945590457f of snapshot=snaptb-1701014104110 to region=1cc117e24a014df5815461dcd6bc9ce1 table=testCompactionWithHFileLink 2023-11-26 15:55:17,996 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ca383d22f31c49e79ff543bd09b71dba of snapshot=snaptb-1701014104110 to region=dd287aba04977d5f4b3a261b02c79746 table=testCompactionWithHFileLink 2023-11-26 15:55:17,998 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/1c90156d895f4082bd0b335d754c23bd to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/1c90156d895f4082bd0b335d754c23bd 2023-11-26 15:55:17,998 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4e1ed16f3099408f9b236ea81463ad33 of snapshot=snaptb-1701014104110 to region=900c2d000cb588ea26813112d428c4a6 table=testCompactionWithHFileLink 2023-11-26 15:55:17,999 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2e3094c168c0454ca21dfb7e9c4724cc of snapshot=snaptb-1701014104110 to region=1cc117e24a014df5815461dcd6bc9ce1 table=testCompactionWithHFileLink 2023-11-26 15:55:18,000 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fde91b6e09f84eea9754e2c4ddb510b5 of snapshot=snaptb-1701014104110 to region=dd287aba04977d5f4b3a261b02c79746 table=testCompactionWithHFileLink 2023-11-26 15:55:18,004 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ae016fb6728f4cbeb72c54a92d72395f of snapshot=snaptb-1701014104110 to region=900c2d000cb588ea26813112d428c4a6 table=testCompactionWithHFileLink 2023-11-26 15:55:18,006 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 026fd04c221d45a0b392c3c766ac455e of snapshot=snaptb-1701014104110 to region=1cc117e24a014df5815461dcd6bc9ce1 table=testCompactionWithHFileLink 2023-11-26 15:55:18,007 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f1440736d19a48dbadf1b913c334b692 of snapshot=snaptb-1701014104110 to region=dd287aba04977d5f4b3a261b02c79746 table=testCompactionWithHFileLink 2023-11-26 15:55:18,009 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f0d0cc00a77e455cadab119cbdd6bc90 of snapshot=snaptb-1701014104110 to region=900c2d000cb588ea26813112d428c4a6 table=testCompactionWithHFileLink 2023-11-26 15:55:18,012 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8894fcc417754593ad6289f843cc9dfc of snapshot=snaptb-1701014104110 to region=900c2d000cb588ea26813112d428c4a6 table=testCompactionWithHFileLink 2023-11-26 15:55:18,015 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1701014104110" table: "testCompactionWithHFileLink" creation_time: 1701014104120 type: FLUSH version: 2 ttl: 0 2023-11-26 15:55:18,016 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1701014118016"}]},"ts":"9223372036854775807"} 2023-11-26 15:55:18,016 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1701014118016"}]},"ts":"9223372036854775807"} 2023-11-26 15:55:18,016 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1701014118016"}]},"ts":"9223372036854775807"} 2023-11-26 15:55:18,018 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-11-26 15:55:18,018 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1cc117e24a014df5815461dcd6bc9ce1, NAME => 'testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 900c2d000cb588ea26813112d428c4a6, NAME => 'testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => dd287aba04977d5f4b3a261b02c79746, NAME => 'testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746.', STARTKEY => '1', ENDKEY => '2'}] 2023-11-26 15:55:18,018 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701014118017"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014118017"}]},"ts":"1701014118017"} 2023-11-26 15:55:18,018 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701014118017"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014118017"}]},"ts":"1701014118017"} 2023-11-26 15:55:18,018 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701014118017"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014118017"}]},"ts":"1701014118017"} 2023-11-26 15:55:18,019 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-26 15:55:18,019 INFO [PEWorker-4] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-11-26 15:55:18,019 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 1cc117e24a014df5815461dcd6bc9ce1, NAME => 'testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 900c2d000cb588ea26813112d428c4a6, NAME => 'testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => dd287aba04977d5f4b3a261b02c79746, NAME => 'testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746.', STARTKEY => '1', ENDKEY => '2'}] 2023-11-26 15:55:18,020 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1701014104110 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-11-26 15:55:18,022 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1701014104110" table: "testCompactionWithHFileLink" creation_time: 1701014104120 type: FLUSH version: 2 ttl: 0 ) in 563 msec 2023-11-26 15:55:18,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-26 15:55:18,078 INFO [Listener at localhost/43645] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-11-26 15:55:18,079 INFO [Listener at localhost/43645] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1701014104110-1701014115303 2023-11-26 15:55:18,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1701014104110-1701014115303" 2023-11-26 15:55:18,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1701014104110-1701014115303 2023-11-26 15:55:18,087 INFO [Listener at localhost/43645] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-11-26 15:55:18,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-11-26 15:55:18,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-11-26 15:55:18,099 INFO [PEWorker-1] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-11-26 15:55:18,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-26 15:55:18,099 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014118099"}]},"ts":"1701014118099"} 2023-11-26 15:55:18,100 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-26 15:55:18,103 DEBUG [PEWorker-1] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-11-26 15:55:18,103 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1cc117e24a014df5815461dcd6bc9ce1, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dd287aba04977d5f4b3a261b02c79746, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=900c2d000cb588ea26813112d428c4a6, ASSIGN}] 2023-11-26 15:55:18,104 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1cc117e24a014df5815461dcd6bc9ce1, ASSIGN 2023-11-26 15:55:18,104 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dd287aba04977d5f4b3a261b02c79746, ASSIGN 2023-11-26 15:55:18,104 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=900c2d000cb588ea26813112d428c4a6, ASSIGN 2023-11-26 15:55:18,105 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dd287aba04977d5f4b3a261b02c79746, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-26 15:55:18,105 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=900c2d000cb588ea26813112d428c4a6, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-26 15:55:18,105 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1cc117e24a014df5815461dcd6bc9ce1, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-26 15:55:18,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-26 15:55:18,256 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=900c2d000cb588ea26813112d428c4a6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:18,256 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=1cc117e24a014df5815461dcd6bc9ce1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:18,256 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=dd287aba04977d5f4b3a261b02c79746, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:18,257 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701014118256"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014118256"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014118256"}]},"ts":"1701014118256"} 2023-11-26 15:55:18,257 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701014118256"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014118256"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014118256"}]},"ts":"1701014118256"} 2023-11-26 15:55:18,257 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701014118256"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014118256"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014118256"}]},"ts":"1701014118256"} 2023-11-26 15:55:18,258 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure 900c2d000cb588ea26813112d428c4a6, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:55:18,259 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=99, state=RUNNABLE; OpenRegionProcedure dd287aba04977d5f4b3a261b02c79746, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:55:18,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure 1cc117e24a014df5815461dcd6bc9ce1, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:55:18,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-26 15:55:18,410 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:18,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:55:18,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dd287aba04977d5f4b3a261b02c79746, NAME => 'testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746.', STARTKEY => '1', ENDKEY => '2'} 2023-11-26 15:55:18,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:55:18,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:55:18,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:55:18,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:55:18,415 INFO [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:55:18,415 DEBUG [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1 2023-11-26 15:55:18,416 DEBUG [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1 2023-11-26 15:55:18,416 INFO [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd287aba04977d5f4b3a261b02c79746 columnFamilyName family1 2023-11-26 15:55:18,425 DEBUG [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-47741ead1ae940b2a3fc6b01ddd532bb 2023-11-26 15:55:18,430 DEBUG [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-646cfe52791142b4939f824adab394a1 2023-11-26 15:55:18,434 DEBUG [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-878fdc9fd5214d9e901aca452f0b5369 2023-11-26 15:55:18,438 DEBUG [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-b17df9b698254d84845aab04224498f4 2023-11-26 15:55:18,438 INFO [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] regionserver.HStore(310): Store=dd287aba04977d5f4b3a261b02c79746/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:55:18,439 INFO [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:55:18,439 DEBUG [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2 2023-11-26 15:55:18,439 DEBUG [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2 2023-11-26 15:55:18,440 INFO [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd287aba04977d5f4b3a261b02c79746 columnFamilyName family2 2023-11-26 15:55:18,448 DEBUG [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-4018d6308c69481b80b6f546d1b9f244 2023-11-26 15:55:18,452 DEBUG [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-ca383d22f31c49e79ff543bd09b71dba 2023-11-26 15:55:18,462 DEBUG [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-f1440736d19a48dbadf1b913c334b692 2023-11-26 15:55:18,468 DEBUG [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-fde91b6e09f84eea9754e2c4ddb510b5 2023-11-26 15:55:18,468 INFO [StoreOpener-dd287aba04977d5f4b3a261b02c79746-1] regionserver.HStore(310): Store=dd287aba04977d5f4b3a261b02c79746/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:55:18,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:55:18,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:55:18,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-26 15:55:18,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:55:18,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dd287aba04977d5f4b3a261b02c79746; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65993879, jitterRate=-0.01661457121372223}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-26 15:55:18,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dd287aba04977d5f4b3a261b02c79746: 2023-11-26 15:55:18,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746., pid=102, masterSystemTime=1701014118410 2023-11-26 15:55:18,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:55:18,476 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-26 15:55:18,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-26 15:55:18,476 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-26 15:55:18,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:55:18,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:55:18,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:55:18,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1cc117e24a014df5815461dcd6bc9ce1, NAME => 'testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1.', STARTKEY => '', ENDKEY => '1'} 2023-11-26 15:55:18,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:55:18,478 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=dd287aba04977d5f4b3a261b02c79746, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:18,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:55:18,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:55:18,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:55:18,479 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701014118478"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014118478"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014118478"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014118478"}]},"ts":"1701014118478"} 2023-11-26 15:55:18,480 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-26 15:55:18,480 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1912): dd287aba04977d5f4b3a261b02c79746/family1 is initiating minor compaction (all files) 2023-11-26 15:55:18,480 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of dd287aba04977d5f4b3a261b02c79746/family1 in testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:55:18,480 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-47741ead1ae940b2a3fc6b01ddd532bb, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-878fdc9fd5214d9e901aca452f0b5369, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-b17df9b698254d84845aab04224498f4, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-646cfe52791142b4939f824adab394a1] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp, totalSize=21.6 K 2023-11-26 15:55:18,480 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-26 15:55:18,480 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.HStore(1912): dd287aba04977d5f4b3a261b02c79746/family2 is initiating minor compaction (all files) 2023-11-26 15:55:18,480 INFO [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.HRegion(2259): Starting compaction of dd287aba04977d5f4b3a261b02c79746/family2 in testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:55:18,480 INFO [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-4018d6308c69481b80b6f546d1b9f244, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-ca383d22f31c49e79ff543bd09b71dba, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-fde91b6e09f84eea9754e2c4ddb510b5, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-f1440736d19a48dbadf1b913c334b692] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp, totalSize=20.4 K 2023-11-26 15:55:18,481 INFO [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:55:18,482 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=102, resume processing ppid=99 2023-11-26 15:55:18,482 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=99, state=SUCCESS; OpenRegionProcedure dd287aba04977d5f4b3a261b02c79746, server=jenkins-hbase4.apache.org,41861,1701014000937 in 221 msec 2023-11-26 15:55:18,482 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-47741ead1ae940b2a3fc6b01ddd532bb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014097264 2023-11-26 15:55:18,482 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-4018d6308c69481b80b6f546d1b9f244, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014097264 2023-11-26 15:55:18,483 DEBUG [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1 2023-11-26 15:55:18,483 DEBUG [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1 2023-11-26 15:55:18,483 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=dd287aba04977d5f4b3a261b02c79746, ASSIGN in 379 msec 2023-11-26 15:55:18,483 INFO [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1cc117e24a014df5815461dcd6bc9ce1 columnFamilyName family1 2023-11-26 15:55:18,483 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-878fdc9fd5214d9e901aca452f0b5369, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014099079 2023-11-26 15:55:18,483 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-ca383d22f31c49e79ff543bd09b71dba, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014099079 2023-11-26 15:55:18,488 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-b17df9b698254d84845aab04224498f4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014100895 2023-11-26 15:55:18,489 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-fde91b6e09f84eea9754e2c4ddb510b5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014100895 2023-11-26 15:55:18,489 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-646cfe52791142b4939f824adab394a1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014102704 2023-11-26 15:55:18,492 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-f1440736d19a48dbadf1b913c334b692, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014102704 2023-11-26 15:55:18,501 DEBUG [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-081ad50692d243e28d9e522b92b508e8 2023-11-26 15:55:18,510 DEBUG [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-2753710c7d794b5884b18c02f38e9bcd 2023-11-26 15:55:18,519 INFO [RS:0;jenkins-hbase4:41861-longCompactions-0] throttle.PressureAwareThroughputController(145): dd287aba04977d5f4b3a261b02c79746#family2#compaction#114 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:18,519 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] throttle.PressureAwareThroughputController(145): dd287aba04977d5f4b3a261b02c79746#family1#compaction#115 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:18,521 DEBUG [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-28077643ac3d4174a87e2a86d0d4ce53 2023-11-26 15:55:18,522 DEBUG [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-68b01851f116456fb29a8a135104f863 2023-11-26 15:55:18,522 INFO [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] regionserver.HStore(310): Store=1cc117e24a014df5815461dcd6bc9ce1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:55:18,522 INFO [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:55:18,523 DEBUG [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2 2023-11-26 15:55:18,523 DEBUG [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2 2023-11-26 15:55:18,524 INFO [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1cc117e24a014df5815461dcd6bc9ce1 columnFamilyName family2 2023-11-26 15:55:18,529 DEBUG [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-026fd04c221d45a0b392c3c766ac455e 2023-11-26 15:55:18,532 DEBUG [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-2e3094c168c0454ca21dfb7e9c4724cc 2023-11-26 15:55:18,536 DEBUG [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-346fe445f40d49e5acba25945590457f 2023-11-26 15:55:18,540 DEBUG [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-75f40a13c3774903aa3895831d86437c 2023-11-26 15:55:18,540 INFO [StoreOpener-1cc117e24a014df5815461dcd6bc9ce1-1] regionserver.HStore(310): Store=1cc117e24a014df5815461dcd6bc9ce1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:55:18,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:55:18,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:55:18,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-26 15:55:18,543 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:55:18,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1cc117e24a014df5815461dcd6bc9ce1; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59326484, jitterRate=-0.11596649885177612}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-26 15:55:18,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1cc117e24a014df5815461dcd6bc9ce1: 2023-11-26 15:55:18,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1., pid=103, masterSystemTime=1701014118410 2023-11-26 15:55:18,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-26 15:55:18,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-26 15:55:18,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:55:18,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:55:18,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:55:18,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 900c2d000cb588ea26813112d428c4a6, NAME => 'testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6.', STARTKEY => '2', ENDKEY => ''} 2023-11-26 15:55:18,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 900c2d000cb588ea26813112d428c4a6 2023-11-26 15:55:18,546 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=1cc117e24a014df5815461dcd6bc9ce1, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:18,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:55:18,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 900c2d000cb588ea26813112d428c4a6 2023-11-26 15:55:18,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 900c2d000cb588ea26813112d428c4a6 2023-11-26 15:55:18,546 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701014118546"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014118546"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014118546"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014118546"}]},"ts":"1701014118546"} 2023-11-26 15:55:18,547 INFO [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 900c2d000cb588ea26813112d428c4a6 2023-11-26 15:55:18,548 DEBUG [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1 2023-11-26 15:55:18,548 DEBUG [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1 2023-11-26 15:55:18,548 INFO [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 900c2d000cb588ea26813112d428c4a6 columnFamilyName family1 2023-11-26 15:55:18,549 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=103, resume processing ppid=98 2023-11-26 15:55:18,549 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure 1cc117e24a014df5815461dcd6bc9ce1, server=jenkins-hbase4.apache.org,41861,1701014000937 in 288 msec 2023-11-26 15:55:18,550 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=1cc117e24a014df5815461dcd6bc9ce1, ASSIGN in 446 msec 2023-11-26 15:55:18,554 DEBUG [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-1fe28b79aa0940e6b580460106e65974 2023-11-26 15:55:18,557 DEBUG [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-21da28f4f1cb446b92af01b16ceb0784 2023-11-26 15:55:18,563 DEBUG [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-4aa05e8735e14d5fb85a30feb64b6842 2023-11-26 15:55:18,569 DEBUG [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-a93aa2aec72947c38938f30dcd338726 2023-11-26 15:55:18,569 INFO [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] regionserver.HStore(310): Store=900c2d000cb588ea26813112d428c4a6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:55:18,569 INFO [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 900c2d000cb588ea26813112d428c4a6 2023-11-26 15:55:18,570 DEBUG [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2 2023-11-26 15:55:18,570 DEBUG [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2 2023-11-26 15:55:18,570 INFO [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 900c2d000cb588ea26813112d428c4a6 columnFamilyName family2 2023-11-26 15:55:18,577 DEBUG [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-4e1ed16f3099408f9b236ea81463ad33 2023-11-26 15:55:18,583 DEBUG [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-8894fcc417754593ad6289f843cc9dfc 2023-11-26 15:55:18,588 DEBUG [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-ae016fb6728f4cbeb72c54a92d72395f 2023-11-26 15:55:18,593 DEBUG [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] regionserver.HStore(539): loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-f0d0cc00a77e455cadab119cbdd6bc90 2023-11-26 15:55:18,593 INFO [StoreOpener-900c2d000cb588ea26813112d428c4a6-1] regionserver.HStore(310): Store=900c2d000cb588ea26813112d428c4a6/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:55:18,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6 2023-11-26 15:55:18,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6 2023-11-26 15:55:18,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-26 15:55:18,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 900c2d000cb588ea26813112d428c4a6 2023-11-26 15:55:18,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 900c2d000cb588ea26813112d428c4a6; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73270781, jitterRate=0.09181971848011017}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-26 15:55:18,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 900c2d000cb588ea26813112d428c4a6: 2023-11-26 15:55:18,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6., pid=101, masterSystemTime=1701014118410 2023-11-26 15:55:18,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-26 15:55:18,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-26 15:55:18,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:55:18,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:55:18,600 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=900c2d000cb588ea26813112d428c4a6, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:18,600 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701014118600"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014118600"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014118600"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014118600"}]},"ts":"1701014118600"} 2023-11-26 15:55:18,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=101, resume processing ppid=100 2023-11-26 15:55:18,602 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure 900c2d000cb588ea26813112d428c4a6, server=jenkins-hbase4.apache.org,41861,1701014000937 in 343 msec 2023-11-26 15:55:18,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=100, resume processing ppid=97 2023-11-26 15:55:18,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=900c2d000cb588ea26813112d428c4a6, ASSIGN in 499 msec 2023-11-26 15:55:18,604 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014118604"}]},"ts":"1701014118604"} 2023-11-26 15:55:18,605 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-26 15:55:18,606 INFO [PEWorker-4] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-11-26 15:55:18,608 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 515 msec 2023-11-26 15:55:18,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-26 15:55:18,703 INFO [Listener at localhost/43645] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-11-26 15:55:18,716 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:55:18,724 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:55:18,734 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:55:18,735 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:55:18,741 INFO [Listener at localhost/43645] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-26 15:55:18,754 INFO [Listener at localhost/43645] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-26 15:55:18,754 INFO [Listener at localhost/43645] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-26 15:55:18,755 DEBUG [Listener at localhost/43645] zookeeper.ReadOnlyZKClient(139): Connect 0x733a08d1 to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:55:18,759 DEBUG [Listener at localhost/43645] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2feec68f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:55:18,760 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231126 for table='testCompactionWithHFileLink' and column='family1' 2023-11-26 15:55:18,760 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231126 for table='testCompactionWithHFileLink' and column='family1' 2023-11-26 15:55:18,760 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231126 for table='testCompactionWithHFileLink' and column='family1' 2023-11-26 15:55:19,249 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231126952c2c6f25d94c3b81d25128b5a02ab9 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231126952c2c6f25d94c3b81d25128b5a02ab9 2023-11-26 15:55:19,250 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231126 table='testCompactionWithHFileLink' column='family1' 2023-11-26 15:55:19,252 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112629f442b7c3da493a9ce41476c1c0fe21 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023112629f442b7c3da493a9ce41476c1c0fe21 2023-11-26 15:55:19,253 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231126 table='testCompactionWithHFileLink' column='family1' 2023-11-26 15:55:19,265 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:55:19,270 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:55:19,276 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-26 15:55:19,281 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38082, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-26 15:55:19,290 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231126/family1/e91ba23078a54825b776ff20b46bf3da first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-11-26 15:55:19,291 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=32 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231126/family1/e91ba23078a54825b776ff20b46bf3da}] 2023-11-26 15:55:19,291 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231126/family1/bd2d1166ca864255aaf7d4a44f7dccd8 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-11-26 15:55:19,291 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231126/family1/bd2d1166ca864255aaf7d4a44f7dccd8}] 2023-11-26 15:55:19,299 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231126/family1/bd2d1166ca864255aaf7d4a44f7dccd8 for inclusion in dd287aba04977d5f4b3a261b02c79746/family1 2023-11-26 15:55:19,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231126/family1/e91ba23078a54825b776ff20b46bf3da for inclusion in 1cc117e24a014df5815461dcd6bc9ce1/family1 2023-11-26 15:55:19,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-11-26 15:55:19,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-26 15:55:19,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for dd287aba04977d5f4b3a261b02c79746: 2023-11-26 15:55:19,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231126/family1/bd2d1166ca864255aaf7d4a44f7dccd8 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__vjicu1m6msbrlvr04f8714svs724p084ua7ocnjd505lg5vk1qj7cj61n26u18rf/family1/bd2d1166ca864255aaf7d4a44f7dccd8 2023-11-26 15:55:19,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__vjicu1m6msbrlvr04f8714svs724p084ua7ocnjd505lg5vk1qj7cj61n26u18rf/family1/bd2d1166ca864255aaf7d4a44f7dccd8 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/15a316319e004c3da9ef510aa784a3f3_SeqId_34_ 2023-11-26 15:55:19,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-11-26 15:55:19,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last=1 2023-11-26 15:55:19,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for 1cc117e24a014df5815461dcd6bc9ce1: 2023-11-26 15:55:19,304 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__vjicu1m6msbrlvr04f8714svs724p084ua7ocnjd505lg5vk1qj7cj61n26u18rf/family1/bd2d1166ca864255aaf7d4a44f7dccd8 into dd287aba04977d5f4b3a261b02c79746/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/15a316319e004c3da9ef510aa784a3f3_SeqId_34_ - updating store file list. 2023-11-26 15:55:19,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231126/family1/e91ba23078a54825b776ff20b46bf3da to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__nbf7kgts1uj2a09enqt7osb4e9pmfroae8g24eukjjr85eoo20e2tl25o2co8c62/family1/e91ba23078a54825b776ff20b46bf3da 2023-11-26 15:55:19,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__nbf7kgts1uj2a09enqt7osb4e9pmfroae8g24eukjjr85eoo20e2tl25o2co8c62/family1/e91ba23078a54825b776ff20b46bf3da as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/9146443688404601a4325d8b070d75eb_SeqId_34_ 2023-11-26 15:55:19,308 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/15a316319e004c3da9ef510aa784a3f3_SeqId_34_ into dd287aba04977d5f4b3a261b02c79746/family1 2023-11-26 15:55:19,308 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__vjicu1m6msbrlvr04f8714svs724p084ua7ocnjd505lg5vk1qj7cj61n26u18rf/family1/bd2d1166ca864255aaf7d4a44f7dccd8 into dd287aba04977d5f4b3a261b02c79746/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/15a316319e004c3da9ef510aa784a3f3_SeqId_34_) 2023-11-26 15:55:19,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__nbf7kgts1uj2a09enqt7osb4e9pmfroae8g24eukjjr85eoo20e2tl25o2co8c62/family1/e91ba23078a54825b776ff20b46bf3da into 1cc117e24a014df5815461dcd6bc9ce1/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/9146443688404601a4325d8b070d75eb_SeqId_34_ - updating store file list. 2023-11-26 15:55:19,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__vjicu1m6msbrlvr04f8714svs724p084ua7ocnjd505lg5vk1qj7cj61n26u18rf/family1/bd2d1166ca864255aaf7d4a44f7dccd8 2023-11-26 15:55:19,310 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231126 table='testCompactionWithHFileLink' column='family1' 2023-11-26 15:55:19,311 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:19,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/9146443688404601a4325d8b070d75eb_SeqId_34_ into 1cc117e24a014df5815461dcd6bc9ce1/family1 2023-11-26 15:55:19,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__nbf7kgts1uj2a09enqt7osb4e9pmfroae8g24eukjjr85eoo20e2tl25o2co8c62/family1/e91ba23078a54825b776ff20b46bf3da into 1cc117e24a014df5815461dcd6bc9ce1/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/9146443688404601a4325d8b070d75eb_SeqId_34_) 2023-11-26 15:55:19,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__nbf7kgts1uj2a09enqt7osb4e9pmfroae8g24eukjjr85eoo20e2tl25o2co8c62/family1/e91ba23078a54825b776ff20b46bf3da 2023-11-26 15:55:19,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-26 15:55:19,313 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311269e01de33b3da4b5c9c6a706aa82213c6 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311269e01de33b3da4b5c9c6a706aa82213c6 2023-11-26 15:55:19,314 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231126b68fac10445849b8bdd52d3cdac0bf27 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231126b68fac10445849b8bdd52d3cdac0bf27 2023-11-26 15:55:19,315 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231126d7332dc0e7af47ca941c153160b7f096 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231126d7332dc0e7af47ca941c153160b7f096 2023-11-26 15:55:19,316 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231126d85d0ccc0670444e8124edf44cdfbeee to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231126d85d0ccc0670444e8124edf44cdfbeee 2023-11-26 15:55:19,316 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-26 15:55:19,316 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231126' 2023-11-26 15:55:19,317 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231126 for table='testCompactionWithHFileLink' and column='family1' 2023-11-26 15:55:19,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-26 15:55:19,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(1912): 1cc117e24a014df5815461dcd6bc9ce1/family1 is initiating minor compaction (all files) 2023-11-26 15:55:19,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1106fd8a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-26 15:55:19,324 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231126 table='testCompactionWithHFileLink' column='family1' 2023-11-26 15:55:19,325 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:19,326 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231126123260774e834fc6913eb37fd795185d to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231126123260774e834fc6913eb37fd795185d 2023-11-26 15:55:19,327 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023112626244e342f2148cc85bd213afba54445 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023112626244e342f2148cc85bd213afba54445 2023-11-26 15:55:19,328 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311262aa1b154e66842c99a229dce9c76af5e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311262aa1b154e66842c99a229dce9c76af5e 2023-11-26 15:55:19,329 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231126c3828775b0b84bb2b7b1033d80fa6517 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231126c3828775b0b84bb2b7b1033d80fa6517 2023-11-26 15:55:19,329 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-26 15:55:19,329 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231126' 2023-11-26 15:55:19,329 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231126 for table='testCompactionWithHFileLink' and column='family1' 2023-11-26 15:55:19,340 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family2/52161b58a2f44a7b9c460c752b226034 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/52161b58a2f44a7b9c460c752b226034 2023-11-26 15:55:19,345 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-26 15:55:19,346 INFO [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in dd287aba04977d5f4b3a261b02c79746/family2 of dd287aba04977d5f4b3a261b02c79746 into 52161b58a2f44a7b9c460c752b226034(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:55:19,346 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for dd287aba04977d5f4b3a261b02c79746: 2023-11-26 15:55:19,346 INFO [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746., storeName=dd287aba04977d5f4b3a261b02c79746/family2, priority=12, startTime=1701014118476; duration=0sec 2023-11-26 15:55:19,346 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-26 15:55:19,346 INFO [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 1cc117e24a014df5815461dcd6bc9ce1/family1 in testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:55:19,346 INFO [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-68b01851f116456fb29a8a135104f863, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-2753710c7d794b5884b18c02f38e9bcd, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-081ad50692d243e28d9e522b92b508e8, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-28077643ac3d4174a87e2a86d0d4ce53, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/9146443688404601a4325d8b070d75eb_SeqId_34_] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp, totalSize=28.9 K 2023-11-26 15:55:19,347 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-4018d6308c69481b80b6f546d1b9f244, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-ca383d22f31c49e79ff543bd09b71dba, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-fde91b6e09f84eea9754e2c4ddb510b5, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-f1440736d19a48dbadf1b913c334b692] to archive 2023-11-26 15:55:19,348 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:19,348 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/.tmp/family1/1ef9551e9d9548fab19d24cd04640615 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/1ef9551e9d9548fab19d24cd04640615 2023-11-26 15:55:19,348 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-68b01851f116456fb29a8a135104f863, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014097262 2023-11-26 15:55:19,349 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-2753710c7d794b5884b18c02f38e9bcd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014099079 2023-11-26 15:55:19,350 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-4018d6308c69481b80b6f546d1b9f244 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-4018d6308c69481b80b6f546d1b9f244 2023-11-26 15:55:19,351 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-081ad50692d243e28d9e522b92b508e8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014100895 2023-11-26 15:55:19,351 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-ca383d22f31c49e79ff543bd09b71dba to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-ca383d22f31c49e79ff543bd09b71dba 2023-11-26 15:55:19,352 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-28077643ac3d4174a87e2a86d0d4ce53, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014102703 2023-11-26 15:55:19,352 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.Compactor(207): Compacting 9146443688404601a4325d8b070d75eb_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1701014097262 2023-11-26 15:55:19,353 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-fde91b6e09f84eea9754e2c4ddb510b5 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-fde91b6e09f84eea9754e2c4ddb510b5 2023-11-26 15:55:19,354 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in dd287aba04977d5f4b3a261b02c79746/family1 of dd287aba04977d5f4b3a261b02c79746 into 1ef9551e9d9548fab19d24cd04640615(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:55:19,354 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for dd287aba04977d5f4b3a261b02c79746: 2023-11-26 15:55:19,354 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746., storeName=dd287aba04977d5f4b3a261b02c79746/family1, priority=12, startTime=1701014118476; duration=0sec 2023-11-26 15:55:19,355 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-26 15:55:19,355 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-26 15:55:19,356 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-f1440736d19a48dbadf1b913c334b692 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family2/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-f1440736d19a48dbadf1b913c334b692 2023-11-26 15:55:19,358 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-26 15:55:19,358 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1912): 1cc117e24a014df5815461dcd6bc9ce1/family2 is initiating minor compaction (all files) 2023-11-26 15:55:19,358 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1cc117e24a014df5815461dcd6bc9ce1/family2 in testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:55:19,358 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-75f40a13c3774903aa3895831d86437c, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-346fe445f40d49e5acba25945590457f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-2e3094c168c0454ca21dfb7e9c4724cc, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-026fd04c221d45a0b392c3c766ac455e] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp, totalSize=20.4 K 2023-11-26 15:55:19,360 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-75f40a13c3774903aa3895831d86437c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014097262 2023-11-26 15:55:19,361 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-346fe445f40d49e5acba25945590457f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014099079 2023-11-26 15:55:19,362 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-2e3094c168c0454ca21dfb7e9c4724cc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014100895 2023-11-26 15:55:19,363 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-026fd04c221d45a0b392c3c766ac455e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014102703 2023-11-26 15:55:19,381 INFO [RS:0;jenkins-hbase4:41861-longCompactions-0] throttle.PressureAwareThroughputController(145): 1cc117e24a014df5815461dcd6bc9ce1#family1#compaction#116 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:19,393 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1cc117e24a014df5815461dcd6bc9ce1#family2#compaction#117 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:19,454 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-47741ead1ae940b2a3fc6b01ddd532bb, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-878fdc9fd5214d9e901aca452f0b5369, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-b17df9b698254d84845aab04224498f4, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-646cfe52791142b4939f824adab394a1] to archive 2023-11-26 15:55:19,455 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:19,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-47741ead1ae940b2a3fc6b01ddd532bb to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-47741ead1ae940b2a3fc6b01ddd532bb 2023-11-26 15:55:19,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-878fdc9fd5214d9e901aca452f0b5369 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-878fdc9fd5214d9e901aca452f0b5369 2023-11-26 15:55:19,460 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-b17df9b698254d84845aab04224498f4 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-b17df9b698254d84845aab04224498f4 2023-11-26 15:55:19,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-646cfe52791142b4939f824adab394a1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/family1/testCompactionWithHFileLink=dd287aba04977d5f4b3a261b02c79746-646cfe52791142b4939f824adab394a1 2023-11-26 15:55:19,651 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311261dde9899366745b3ab3fd6f7cc7162db to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311261dde9899366745b3ab3fd6f7cc7162db 2023-11-26 15:55:19,651 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231126 table='testCompactionWithHFileLink' column='family1' 2023-11-26 15:55:19,677 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231126/family1/5bf49c788b914ea782f95d7ba9c7709a first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-11-26 15:55:19,678 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231126/family1/5bf49c788b914ea782f95d7ba9c7709a}] 2023-11-26 15:55:19,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231126/family1/5bf49c788b914ea782f95d7ba9c7709a for inclusion in 900c2d000cb588ea26813112d428c4a6/family1 2023-11-26 15:55:19,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-11-26 15:55:19,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-26 15:55:19,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for 900c2d000cb588ea26813112d428c4a6: 2023-11-26 15:55:19,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231126/family1/5bf49c788b914ea782f95d7ba9c7709a to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__dc7mqpqb9kb0e3efv470r5t46qt67kp0knkfnle3gfjnhehobs9k4r6kml7ugkhc/family1/5bf49c788b914ea782f95d7ba9c7709a 2023-11-26 15:55:19,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__dc7mqpqb9kb0e3efv470r5t46qt67kp0knkfnle3gfjnhehobs9k4r6kml7ugkhc/family1/5bf49c788b914ea782f95d7ba9c7709a as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/0d50f2a368e34bdf85721e0f82d61045_SeqId_34_ 2023-11-26 15:55:19,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__dc7mqpqb9kb0e3efv470r5t46qt67kp0knkfnle3gfjnhehobs9k4r6kml7ugkhc/family1/5bf49c788b914ea782f95d7ba9c7709a into 900c2d000cb588ea26813112d428c4a6/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/0d50f2a368e34bdf85721e0f82d61045_SeqId_34_ - updating store file list. 2023-11-26 15:55:19,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/0d50f2a368e34bdf85721e0f82d61045_SeqId_34_ into 900c2d000cb588ea26813112d428c4a6/family1 2023-11-26 15:55:19,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__dc7mqpqb9kb0e3efv470r5t46qt67kp0knkfnle3gfjnhehobs9k4r6kml7ugkhc/family1/5bf49c788b914ea782f95d7ba9c7709a into 900c2d000cb588ea26813112d428c4a6/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/0d50f2a368e34bdf85721e0f82d61045_SeqId_34_) 2023-11-26 15:55:19,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testCompactionWithHFileLink__dc7mqpqb9kb0e3efv470r5t46qt67kp0knkfnle3gfjnhehobs9k4r6kml7ugkhc/family1/5bf49c788b914ea782f95d7ba9c7709a 2023-11-26 15:55:19,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-26 15:55:19,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-26 15:55:19,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(1912): 900c2d000cb588ea26813112d428c4a6/family1 is initiating minor compaction (all files) 2023-11-26 15:55:19,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4b774e80; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-26 15:55:19,694 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231126 table='testCompactionWithHFileLink' column='family1' 2023-11-26 15:55:19,695 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:19,696 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231126249a37657ef94cb7b3447b02179b0f32 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231126249a37657ef94cb7b3447b02179b0f32 2023-11-26 15:55:19,698 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311262a00b7a0281d4b98a765c16de254c7d3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311262a00b7a0281d4b98a765c16de254c7d3 2023-11-26 15:55:19,699 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231126e6381db945a24f54844a145429b91d6a to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231126e6381db945a24f54844a145429b91d6a 2023-11-26 15:55:19,700 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231126f11df26d44774221847b9915bc03112c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231126f11df26d44774221847b9915bc03112c 2023-11-26 15:55:19,700 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-26 15:55:19,700 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231126' 2023-11-26 15:55:19,700 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231126 for table='testCompactionWithHFileLink' and column='family1' 2023-11-26 15:55:19,700 INFO [Listener at localhost/43645] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-26 15:55:19,703 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:55:19,709 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:55:19,712 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:55:19,713 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:55:19,724 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:55:19,726 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:55:19,747 INFO [Listener at localhost/43645] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=289 (was 238) - Thread LEAK? -, OpenFileDescriptor=797 (was 622) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=198 (was 167) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 171), AvailableMemoryMB=8804 (was 8281) - AvailableMemoryMB LEAK? - 2023-11-26 15:55:19,761 INFO [Listener at localhost/43645] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=289, OpenFileDescriptor=797, MaxFileDescriptor=60000, SystemLoadAverage=198, ProcessCount=169, AvailableMemoryMB=8800 2023-11-26 15:55:19,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-11-26 15:55:19,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-11-26 15:55:19,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-26 15:55:19,774 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-26 15:55:19,776 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 8 msec 2023-11-26 15:55:19,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-26 15:55:19,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-26 15:55:19,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-11-26 15:55:19,876 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-26 15:55:19,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-11-26 15:55:19,877 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-26 15:55:19,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-26 15:55:19,879 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855 2023-11-26 15:55:19,879 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3 2023-11-26 15:55:19,879 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a 2023-11-26 15:55:19,880 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855 empty. 2023-11-26 15:55:19,880 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a empty. 2023-11-26 15:55:19,880 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3 empty. 2023-11-26 15:55:19,880 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855 2023-11-26 15:55:19,880 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a 2023-11-26 15:55:19,880 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3 2023-11-26 15:55:19,880 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-11-26 15:55:19,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-26 15:55:20,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-26 15:55:20,215 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family2/d1e3a459e4aa43fcafa0cb59fe8e8a7f as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/d1e3a459e4aa43fcafa0cb59fe8e8a7f 2023-11-26 15:55:20,220 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 1cc117e24a014df5815461dcd6bc9ce1/family2 of 1cc117e24a014df5815461dcd6bc9ce1 into d1e3a459e4aa43fcafa0cb59fe8e8a7f(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:55:20,220 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1cc117e24a014df5815461dcd6bc9ce1: 2023-11-26 15:55:20,221 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1., storeName=1cc117e24a014df5815461dcd6bc9ce1/family2, priority=12, startTime=1701014118545; duration=0sec 2023-11-26 15:55:20,221 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-26 15:55:20,221 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 900c2d000cb588ea26813112d428c4a6/family1 in testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:55:20,221 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-4aa05e8735e14d5fb85a30feb64b6842, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-21da28f4f1cb446b92af01b16ceb0784, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-a93aa2aec72947c38938f30dcd338726, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-1fe28b79aa0940e6b580460106e65974, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/0d50f2a368e34bdf85721e0f82d61045_SeqId_34_] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp, totalSize=28.9 K 2023-11-26 15:55:20,222 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-4aa05e8735e14d5fb85a30feb64b6842, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014097265 2023-11-26 15:55:20,222 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-21da28f4f1cb446b92af01b16ceb0784, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014099079 2023-11-26 15:55:20,222 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-a93aa2aec72947c38938f30dcd338726, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014100895 2023-11-26 15:55:20,223 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-1fe28b79aa0940e6b580460106e65974, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014102704 2023-11-26 15:55:20,223 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 0d50f2a368e34bdf85721e0f82d61045_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1701014097265 2023-11-26 15:55:20,236 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] throttle.PressureAwareThroughputController(145): 900c2d000cb588ea26813112d428c4a6#family1#compaction#118 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:20,248 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-75f40a13c3774903aa3895831d86437c, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-346fe445f40d49e5acba25945590457f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-2e3094c168c0454ca21dfb7e9c4724cc, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-026fd04c221d45a0b392c3c766ac455e] to archive 2023-11-26 15:55:20,248 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:20,250 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-75f40a13c3774903aa3895831d86437c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-75f40a13c3774903aa3895831d86437c 2023-11-26 15:55:20,251 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-346fe445f40d49e5acba25945590457f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-346fe445f40d49e5acba25945590457f 2023-11-26 15:55:20,252 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-2e3094c168c0454ca21dfb7e9c4724cc to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-2e3094c168c0454ca21dfb7e9c4724cc 2023-11-26 15:55:20,254 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-026fd04c221d45a0b392c3c766ac455e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family2/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-026fd04c221d45a0b392c3c766ac455e 2023-11-26 15:55:20,287 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-11-26 15:55:20,289 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 7b89b16a24fd848ba52ba52ed226f03a, NAME => 'ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:55:20,289 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => e0acbef3eb947d2e75284917359a9855, NAME => 'ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:55:20,289 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 26d86fc5d3975b9de436cf03709f95f3, NAME => 'ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:55:20,298 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:55:20,298 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing e0acbef3eb947d2e75284917359a9855, disabling compactions & flushes 2023-11-26 15:55:20,298 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:55:20,298 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:55:20,299 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. after waiting 0 ms 2023-11-26 15:55:20,299 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:55:20,299 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:55:20,299 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 7b89b16a24fd848ba52ba52ed226f03a, disabling compactions & flushes 2023-11-26 15:55:20,299 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:55:20,299 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:55:20,299 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for e0acbef3eb947d2e75284917359a9855: 2023-11-26 15:55:20,299 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:55:20,299 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. after waiting 0 ms 2023-11-26 15:55:20,299 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:55:20,299 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:55:20,299 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 7b89b16a24fd848ba52ba52ed226f03a: 2023-11-26 15:55:20,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-26 15:55:20,610 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/.tmp/family1/a97095328e4f4d75acbd21a8c7afd8f3 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/a97095328e4f4d75acbd21a8c7afd8f3 2023-11-26 15:55:20,615 INFO [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 1cc117e24a014df5815461dcd6bc9ce1/family1 of 1cc117e24a014df5815461dcd6bc9ce1 into a97095328e4f4d75acbd21a8c7afd8f3(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-26 15:55:20,615 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1cc117e24a014df5815461dcd6bc9ce1: 2023-11-26 15:55:20,615 INFO [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1701014119323; duration=1sec 2023-11-26 15:55:20,615 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-26 15:55:20,615 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-11-26 15:55:20,615 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-26 15:55:20,615 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-26 15:55:20,615 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. because compaction request was cancelled 2023-11-26 15:55:20,615 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-26 15:55:20,617 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-26 15:55:20,617 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.HStore(1912): 900c2d000cb588ea26813112d428c4a6/family2 is initiating minor compaction (all files) 2023-11-26 15:55:20,617 INFO [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 900c2d000cb588ea26813112d428c4a6/family2 in testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:55:20,618 INFO [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-4e1ed16f3099408f9b236ea81463ad33, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-ae016fb6728f4cbeb72c54a92d72395f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-f0d0cc00a77e455cadab119cbdd6bc90, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-8894fcc417754593ad6289f843cc9dfc] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp, totalSize=20.4 K 2023-11-26 15:55:20,618 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-4e1ed16f3099408f9b236ea81463ad33, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014097265 2023-11-26 15:55:20,619 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-ae016fb6728f4cbeb72c54a92d72395f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014099079 2023-11-26 15:55:20,619 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-f0d0cc00a77e455cadab119cbdd6bc90, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014100895 2023-11-26 15:55:20,620 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-8894fcc417754593ad6289f843cc9dfc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014102704 2023-11-26 15:55:20,631 INFO [RS:0;jenkins-hbase4:41861-longCompactions-0] throttle.PressureAwareThroughputController(145): 900c2d000cb588ea26813112d428c4a6#family2#compaction#119 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:20,647 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-68b01851f116456fb29a8a135104f863, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-2753710c7d794b5884b18c02f38e9bcd, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-081ad50692d243e28d9e522b92b508e8, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-28077643ac3d4174a87e2a86d0d4ce53, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/9146443688404601a4325d8b070d75eb_SeqId_34_] to archive 2023-11-26 15:55:20,647 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:20,649 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-68b01851f116456fb29a8a135104f863 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-68b01851f116456fb29a8a135104f863 2023-11-26 15:55:20,649 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-2753710c7d794b5884b18c02f38e9bcd to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-2753710c7d794b5884b18c02f38e9bcd 2023-11-26 15:55:20,650 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-081ad50692d243e28d9e522b92b508e8 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-081ad50692d243e28d9e522b92b508e8 2023-11-26 15:55:20,651 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-28077643ac3d4174a87e2a86d0d4ce53 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/testCompactionWithHFileLink=1cc117e24a014df5815461dcd6bc9ce1-28077643ac3d4174a87e2a86d0d4ce53 2023-11-26 15:55:20,652 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/9146443688404601a4325d8b070d75eb_SeqId_34_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/family1/9146443688404601a4325d8b070d75eb_SeqId_34_ 2023-11-26 15:55:20,699 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:55:20,699 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 26d86fc5d3975b9de436cf03709f95f3, disabling compactions & flushes 2023-11-26 15:55:20,699 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:55:20,699 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:55:20,699 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. after waiting 0 ms 2023-11-26 15:55:20,699 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:55:20,699 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:55:20,699 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 26d86fc5d3975b9de436cf03709f95f3: 2023-11-26 15:55:20,701 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-26 15:55:20,702 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701014120702"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014120702"}]},"ts":"1701014120702"} 2023-11-26 15:55:20,703 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701014120702"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014120702"}]},"ts":"1701014120702"} 2023-11-26 15:55:20,703 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1701014120702"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014120702"}]},"ts":"1701014120702"} 2023-11-26 15:55:20,705 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-26 15:55:20,705 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-26 15:55:20,706 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014120705"}]},"ts":"1701014120705"} 2023-11-26 15:55:20,707 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-11-26 15:55:20,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=e0acbef3eb947d2e75284917359a9855, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=26d86fc5d3975b9de436cf03709f95f3, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7b89b16a24fd848ba52ba52ed226f03a, ASSIGN}] 2023-11-26 15:55:20,716 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=e0acbef3eb947d2e75284917359a9855, ASSIGN 2023-11-26 15:55:20,716 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7b89b16a24fd848ba52ba52ed226f03a, ASSIGN 2023-11-26 15:55:20,716 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=26d86fc5d3975b9de436cf03709f95f3, ASSIGN 2023-11-26 15:55:20,717 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=e0acbef3eb947d2e75284917359a9855, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:55:20,717 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7b89b16a24fd848ba52ba52ed226f03a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:55:20,717 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=26d86fc5d3975b9de436cf03709f95f3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:55:20,718 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-26 15:55:20,870 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=26d86fc5d3975b9de436cf03709f95f3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:20,870 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e0acbef3eb947d2e75284917359a9855, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:20,870 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=7b89b16a24fd848ba52ba52ed226f03a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:20,870 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1701014120870"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014120870"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014120870"}]},"ts":"1701014120870"} 2023-11-26 15:55:20,870 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701014120870"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014120870"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014120870"}]},"ts":"1701014120870"} 2023-11-26 15:55:20,870 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701014120870"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014120870"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014120870"}]},"ts":"1701014120870"} 2023-11-26 15:55:20,872 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 26d86fc5d3975b9de436cf03709f95f3, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:55:20,873 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure 7b89b16a24fd848ba52ba52ed226f03a, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:55:20,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=106, state=RUNNABLE; OpenRegionProcedure e0acbef3eb947d2e75284917359a9855, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:55:20,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-26 15:55:21,024 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:21,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:55:21,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 26d86fc5d3975b9de436cf03709f95f3, NAME => 'ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3.', STARTKEY => '1', ENDKEY => '2'} 2023-11-26 15:55:21,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 26d86fc5d3975b9de436cf03709f95f3 2023-11-26 15:55:21,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:55:21,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 26d86fc5d3975b9de436cf03709f95f3 2023-11-26 15:55:21,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 26d86fc5d3975b9de436cf03709f95f3 2023-11-26 15:55:21,029 INFO [StoreOpener-26d86fc5d3975b9de436cf03709f95f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 26d86fc5d3975b9de436cf03709f95f3 2023-11-26 15:55:21,031 DEBUG [StoreOpener-26d86fc5d3975b9de436cf03709f95f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1 2023-11-26 15:55:21,031 DEBUG [StoreOpener-26d86fc5d3975b9de436cf03709f95f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1 2023-11-26 15:55:21,031 INFO [StoreOpener-26d86fc5d3975b9de436cf03709f95f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26d86fc5d3975b9de436cf03709f95f3 columnFamilyName family1 2023-11-26 15:55:21,032 INFO [StoreOpener-26d86fc5d3975b9de436cf03709f95f3-1] regionserver.HStore(310): Store=26d86fc5d3975b9de436cf03709f95f3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:55:21,033 INFO [StoreOpener-26d86fc5d3975b9de436cf03709f95f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 26d86fc5d3975b9de436cf03709f95f3 2023-11-26 15:55:21,034 DEBUG [StoreOpener-26d86fc5d3975b9de436cf03709f95f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2 2023-11-26 15:55:21,034 DEBUG [StoreOpener-26d86fc5d3975b9de436cf03709f95f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2 2023-11-26 15:55:21,034 INFO [StoreOpener-26d86fc5d3975b9de436cf03709f95f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26d86fc5d3975b9de436cf03709f95f3 columnFamilyName family2 2023-11-26 15:55:21,035 INFO [StoreOpener-26d86fc5d3975b9de436cf03709f95f3-1] regionserver.HStore(310): Store=26d86fc5d3975b9de436cf03709f95f3/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:55:21,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3 2023-11-26 15:55:21,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3 2023-11-26 15:55:21,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-26 15:55:21,040 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 26d86fc5d3975b9de436cf03709f95f3 2023-11-26 15:55:21,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:55:21,042 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 26d86fc5d3975b9de436cf03709f95f3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64861124, jitterRate=-0.03349393606185913}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-26 15:55:21,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 26d86fc5d3975b9de436cf03709f95f3: 2023-11-26 15:55:21,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3., pid=109, masterSystemTime=1701014121024 2023-11-26 15:55:21,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:55:21,044 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:55:21,044 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:55:21,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e0acbef3eb947d2e75284917359a9855, NAME => 'ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855.', STARTKEY => '', ENDKEY => '1'} 2023-11-26 15:55:21,044 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=26d86fc5d3975b9de436cf03709f95f3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:21,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction e0acbef3eb947d2e75284917359a9855 2023-11-26 15:55:21,045 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1701014121044"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014121044"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014121044"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014121044"}]},"ts":"1701014121044"} 2023-11-26 15:55:21,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:55:21,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e0acbef3eb947d2e75284917359a9855 2023-11-26 15:55:21,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e0acbef3eb947d2e75284917359a9855 2023-11-26 15:55:21,046 INFO [StoreOpener-e0acbef3eb947d2e75284917359a9855-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e0acbef3eb947d2e75284917359a9855 2023-11-26 15:55:21,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=109, resume processing ppid=107 2023-11-26 15:55:21,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 26d86fc5d3975b9de436cf03709f95f3, server=jenkins-hbase4.apache.org,41861,1701014000937 in 174 msec 2023-11-26 15:55:21,048 DEBUG [StoreOpener-e0acbef3eb947d2e75284917359a9855-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1 2023-11-26 15:55:21,048 DEBUG [StoreOpener-e0acbef3eb947d2e75284917359a9855-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1 2023-11-26 15:55:21,048 INFO [StoreOpener-e0acbef3eb947d2e75284917359a9855-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e0acbef3eb947d2e75284917359a9855 columnFamilyName family1 2023-11-26 15:55:21,048 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=26d86fc5d3975b9de436cf03709f95f3, ASSIGN in 333 msec 2023-11-26 15:55:21,049 INFO [StoreOpener-e0acbef3eb947d2e75284917359a9855-1] regionserver.HStore(310): Store=e0acbef3eb947d2e75284917359a9855/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:55:21,049 INFO [StoreOpener-e0acbef3eb947d2e75284917359a9855-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e0acbef3eb947d2e75284917359a9855 2023-11-26 15:55:21,050 DEBUG [StoreOpener-e0acbef3eb947d2e75284917359a9855-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2 2023-11-26 15:55:21,051 DEBUG [StoreOpener-e0acbef3eb947d2e75284917359a9855-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2 2023-11-26 15:55:21,051 INFO [StoreOpener-e0acbef3eb947d2e75284917359a9855-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e0acbef3eb947d2e75284917359a9855 columnFamilyName family2 2023-11-26 15:55:21,052 INFO [StoreOpener-e0acbef3eb947d2e75284917359a9855-1] regionserver.HStore(310): Store=e0acbef3eb947d2e75284917359a9855/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:55:21,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855 2023-11-26 15:55:21,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855 2023-11-26 15:55:21,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-26 15:55:21,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e0acbef3eb947d2e75284917359a9855 2023-11-26 15:55:21,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:55:21,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e0acbef3eb947d2e75284917359a9855; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68754165, jitterRate=0.024516895413398743}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-26 15:55:21,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e0acbef3eb947d2e75284917359a9855: 2023-11-26 15:55:21,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855., pid=111, masterSystemTime=1701014121024 2023-11-26 15:55:21,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:55:21,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:55:21,060 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:55:21,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7b89b16a24fd848ba52ba52ed226f03a, NAME => 'ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a.', STARTKEY => '2', ENDKEY => ''} 2023-11-26 15:55:21,061 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e0acbef3eb947d2e75284917359a9855, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:21,061 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701014121061"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014121061"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014121061"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014121061"}]},"ts":"1701014121061"} 2023-11-26 15:55:21,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 7b89b16a24fd848ba52ba52ed226f03a 2023-11-26 15:55:21,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:55:21,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7b89b16a24fd848ba52ba52ed226f03a 2023-11-26 15:55:21,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7b89b16a24fd848ba52ba52ed226f03a 2023-11-26 15:55:21,062 INFO [StoreOpener-7b89b16a24fd848ba52ba52ed226f03a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7b89b16a24fd848ba52ba52ed226f03a 2023-11-26 15:55:21,063 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=111, resume processing ppid=106 2023-11-26 15:55:21,063 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=106, state=SUCCESS; OpenRegionProcedure e0acbef3eb947d2e75284917359a9855, server=jenkins-hbase4.apache.org,41861,1701014000937 in 189 msec 2023-11-26 15:55:21,064 DEBUG [StoreOpener-7b89b16a24fd848ba52ba52ed226f03a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1 2023-11-26 15:55:21,064 DEBUG [StoreOpener-7b89b16a24fd848ba52ba52ed226f03a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1 2023-11-26 15:55:21,064 INFO [StoreOpener-7b89b16a24fd848ba52ba52ed226f03a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b89b16a24fd848ba52ba52ed226f03a columnFamilyName family1 2023-11-26 15:55:21,064 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=e0acbef3eb947d2e75284917359a9855, ASSIGN in 349 msec 2023-11-26 15:55:21,065 INFO [StoreOpener-7b89b16a24fd848ba52ba52ed226f03a-1] regionserver.HStore(310): Store=7b89b16a24fd848ba52ba52ed226f03a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:55:21,065 INFO [StoreOpener-7b89b16a24fd848ba52ba52ed226f03a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7b89b16a24fd848ba52ba52ed226f03a 2023-11-26 15:55:21,067 DEBUG [StoreOpener-7b89b16a24fd848ba52ba52ed226f03a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2 2023-11-26 15:55:21,067 DEBUG [StoreOpener-7b89b16a24fd848ba52ba52ed226f03a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2 2023-11-26 15:55:21,067 INFO [StoreOpener-7b89b16a24fd848ba52ba52ed226f03a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b89b16a24fd848ba52ba52ed226f03a columnFamilyName family2 2023-11-26 15:55:21,068 INFO [StoreOpener-7b89b16a24fd848ba52ba52ed226f03a-1] regionserver.HStore(310): Store=7b89b16a24fd848ba52ba52ed226f03a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:55:21,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a 2023-11-26 15:55:21,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a 2023-11-26 15:55:21,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-26 15:55:21,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7b89b16a24fd848ba52ba52ed226f03a 2023-11-26 15:55:21,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:55:21,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7b89b16a24fd848ba52ba52ed226f03a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65844896, jitterRate=-0.018834590911865234}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-26 15:55:21,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7b89b16a24fd848ba52ba52ed226f03a: 2023-11-26 15:55:21,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a., pid=110, masterSystemTime=1701014121024 2023-11-26 15:55:21,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:55:21,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:55:21,075 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=7b89b16a24fd848ba52ba52ed226f03a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:21,075 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701014121075"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014121075"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014121075"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014121075"}]},"ts":"1701014121075"} 2023-11-26 15:55:21,077 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=110, resume processing ppid=108 2023-11-26 15:55:21,078 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure 7b89b16a24fd848ba52ba52ed226f03a, server=jenkins-hbase4.apache.org,41861,1701014000937 in 205 msec 2023-11-26 15:55:21,079 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=108, resume processing ppid=105 2023-11-26 15:55:21,079 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7b89b16a24fd848ba52ba52ed226f03a, ASSIGN in 364 msec 2023-11-26 15:55:21,079 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-26 15:55:21,079 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014121079"}]},"ts":"1701014121079"} 2023-11-26 15:55:21,080 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-11-26 15:55:21,083 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-26 15:55:21,084 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2090 sec 2023-11-26 15:55:21,448 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family2/7da913d0a3b74416b92afe07f81e7efd as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/7da913d0a3b74416b92afe07f81e7efd 2023-11-26 15:55:21,453 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/.tmp/family1/5627f36efd7445cf8bad7951a34e0e2e as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/5627f36efd7445cf8bad7951a34e0e2e 2023-11-26 15:55:21,453 INFO [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 900c2d000cb588ea26813112d428c4a6/family2 of 900c2d000cb588ea26813112d428c4a6 into 7da913d0a3b74416b92afe07f81e7efd(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:55:21,453 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 900c2d000cb588ea26813112d428c4a6: 2023-11-26 15:55:21,453 INFO [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6., storeName=900c2d000cb588ea26813112d428c4a6/family2, priority=12, startTime=1701014118598; duration=0sec 2023-11-26 15:55:21,453 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-26 15:55:21,453 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-26 15:55:21,454 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-26 15:55:21,454 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-26 15:55:21,454 DEBUG [RS:0;jenkins-hbase4:41861-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. because compaction request was cancelled 2023-11-26 15:55:21,456 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-4e1ed16f3099408f9b236ea81463ad33, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-ae016fb6728f4cbeb72c54a92d72395f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-f0d0cc00a77e455cadab119cbdd6bc90, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-8894fcc417754593ad6289f843cc9dfc] to archive 2023-11-26 15:55:21,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:21,457 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 900c2d000cb588ea26813112d428c4a6/family1 of 900c2d000cb588ea26813112d428c4a6 into 5627f36efd7445cf8bad7951a34e0e2e(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-26 15:55:21,457 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 900c2d000cb588ea26813112d428c4a6: 2023-11-26 15:55:21,457 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1701014119692; duration=1sec 2023-11-26 15:55:21,457 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:55:21,458 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-4e1ed16f3099408f9b236ea81463ad33 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-4e1ed16f3099408f9b236ea81463ad33 2023-11-26 15:55:21,460 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-ae016fb6728f4cbeb72c54a92d72395f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-ae016fb6728f4cbeb72c54a92d72395f 2023-11-26 15:55:21,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-f0d0cc00a77e455cadab119cbdd6bc90 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-f0d0cc00a77e455cadab119cbdd6bc90 2023-11-26 15:55:21,462 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-8894fcc417754593ad6289f843cc9dfc to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family2/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-8894fcc417754593ad6289f843cc9dfc 2023-11-26 15:55:21,547 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-4aa05e8735e14d5fb85a30feb64b6842, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-21da28f4f1cb446b92af01b16ceb0784, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-a93aa2aec72947c38938f30dcd338726, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-1fe28b79aa0940e6b580460106e65974, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/0d50f2a368e34bdf85721e0f82d61045_SeqId_34_] to archive 2023-11-26 15:55:21,548 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:21,549 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-4aa05e8735e14d5fb85a30feb64b6842 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-4aa05e8735e14d5fb85a30feb64b6842 2023-11-26 15:55:21,551 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-21da28f4f1cb446b92af01b16ceb0784 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-21da28f4f1cb446b92af01b16ceb0784 2023-11-26 15:55:21,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-a93aa2aec72947c38938f30dcd338726 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-a93aa2aec72947c38938f30dcd338726 2023-11-26 15:55:21,553 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-1fe28b79aa0940e6b580460106e65974 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/testCompactionWithHFileLink=900c2d000cb588ea26813112d428c4a6-1fe28b79aa0940e6b580460106e65974 2023-11-26 15:55:21,554 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/0d50f2a368e34bdf85721e0f82d61045_SeqId_34_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/family1/0d50f2a368e34bdf85721e0f82d61045_SeqId_34_ 2023-11-26 15:55:21,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-26 15:55:21,983 INFO [Listener at localhost/43645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-11-26 15:55:21,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:21,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:21,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:21,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:21,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-26 15:55:21,996 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-26 15:55:21,996 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:21,996 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-26 15:55:21,996 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-26 15:55:21,996 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:21,996 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:21,998 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:21,998 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:21,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:21,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:21,998 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:21,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:21,998 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:21,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:21,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:21,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:21,999 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-26 15:55:22,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-26 15:55:22,000 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-26 15:55:22,000 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:22,000 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-26 15:55:22,021 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:55:22,021 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:55:22,021 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. started... 2023-11-26 15:55:22,021 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-26 15:55:22,021 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:22,021 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:55:22,023 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7b89b16a24fd848ba52ba52ed226f03a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-26 15:55:22,021 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. started... 2023-11-26 15:55:22,023 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. started... 2023-11-26 15:55:22,023 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-26 15:55:22,023 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e0acbef3eb947d2e75284917359a9855 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-26 15:55:22,023 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 26d86fc5d3975b9de436cf03709f95f3 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-26 15:55:22,023 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d5cf3ea to 127.0.0.1:58210 2023-11-26 15:55:22,023 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:55:22,024 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-26 15:55:22,024 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x577dcbf2 to 127.0.0.1:58210 2023-11-26 15:55:22,025 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:55:22,025 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-26 15:55:22,025 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x733a08d1 to 127.0.0.1:58210 2023-11-26 15:55:22,026 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:55:22,046 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231126c1cdedd7d92248dbbd8f1c1ad4b565e7 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231126c1cdedd7d92248dbbd8f1c1ad4b565e7 2023-11-26 15:55:22,046 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126fb8be066efea468b80b4e88d842aa4e4 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231126fb8be066efea468b80b4e88d842aa4e4 2023-11-26 15:55:22,445 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112650dae547214c4b8bbbf7ec543ef82825 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023112650dae547214c4b8bbbf7ec543ef82825 2023-11-26 15:55:22,465 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family1/86a8fa7541b74913960e55570d5a8444 2023-11-26 15:55:22,466 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family1/7b2169df66f7413bbc2727d64e1af9d7 2023-11-26 15:55:22,528 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-26 15:55:22,866 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family1/a47df657da7345c0a571ad2fe0e3a5bb 2023-11-26 15:55:22,888 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126bf25eadf139b4fd98c259ff464a2248a to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231126bf25eadf139b4fd98c259ff464a2248a 2023-11-26 15:55:22,892 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311260bc88e0bc2c84031adf6d5f5f26290b8 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311260bc88e0bc2c84031adf6d5f5f26290b8 2023-11-26 15:55:22,893 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family2/0cf7dd34134049649103f9fa9afa81b5 2023-11-26 15:55:22,897 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family2/bf96c136516846c49cc96ac33d992022 2023-11-26 15:55:22,898 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family1/7b2169df66f7413bbc2727d64e1af9d7 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/7b2169df66f7413bbc2727d64e1af9d7 2023-11-26 15:55:22,903 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family1/86a8fa7541b74913960e55570d5a8444 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/86a8fa7541b74913960e55570d5a8444 2023-11-26 15:55:22,904 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/7b2169df66f7413bbc2727d64e1af9d7, entries=4, sequenceid=5, filesize=5.4 K 2023-11-26 15:55:22,905 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family2/0cf7dd34134049649103f9fa9afa81b5 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/0cf7dd34134049649103f9fa9afa81b5 2023-11-26 15:55:22,909 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/86a8fa7541b74913960e55570d5a8444, entries=4, sequenceid=5, filesize=5.4 K 2023-11-26 15:55:22,913 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family2/bf96c136516846c49cc96ac33d992022 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/bf96c136516846c49cc96ac33d992022 2023-11-26 15:55:22,915 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/0cf7dd34134049649103f9fa9afa81b5, entries=2, sequenceid=5, filesize=5.1 K 2023-11-26 15:55:22,916 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7b89b16a24fd848ba52ba52ed226f03a in 893ms, sequenceid=5, compaction requested=false 2023-11-26 15:55:22,917 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7b89b16a24fd848ba52ba52ed226f03a: 2023-11-26 15:55:22,917 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:55:22,917 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-26 15:55:22,918 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/bf96c136516846c49cc96ac33d992022, entries=2, sequenceid=5, filesize=5.1 K 2023-11-26 15:55:22,918 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 26d86fc5d3975b9de436cf03709f95f3 in 895ms, sequenceid=5, compaction requested=false 2023-11-26 15:55:22,919 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 26d86fc5d3975b9de436cf03709f95f3: 2023-11-26 15:55:22,919 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:55:22,919 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-26 15:55:23,281 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311262c9fdf6bce8548b9a9e74ffcf0471979 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311262c9fdf6bce8548b9a9e74ffcf0471979 2023-11-26 15:55:23,686 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family2/39ba1e00740746c09ba352cfddabc140 2023-11-26 15:55:23,690 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family1/a47df657da7345c0a571ad2fe0e3a5bb as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/a47df657da7345c0a571ad2fe0e3a5bb 2023-11-26 15:55:23,694 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/a47df657da7345c0a571ad2fe0e3a5bb, entries=4, sequenceid=5, filesize=5.4 K 2023-11-26 15:55:23,695 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family2/39ba1e00740746c09ba352cfddabc140 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/39ba1e00740746c09ba352cfddabc140 2023-11-26 15:55:23,698 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/39ba1e00740746c09ba352cfddabc140, entries=2, sequenceid=5, filesize=5.1 K 2023-11-26 15:55:23,699 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for e0acbef3eb947d2e75284917359a9855 in 1676ms, sequenceid=5, compaction requested=false 2023-11-26 15:55:23,699 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e0acbef3eb947d2e75284917359a9855: 2023-11-26 15:55:23,699 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:55:23,699 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-26 15:55:23,699 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-26 15:55:23,699 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:23,699 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-26 15:55:23,699 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-26 15:55:23,701 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:23,701 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:23,701 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:23,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:23,701 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:23,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:23,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:23,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:23,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:23,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-26 15:55:23,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43e39109[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:23,703 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-26 15:55:23,703 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:23,704 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:23,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:23,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:23,704 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-26 15:55:23,704 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-26 15:55:23,704 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:23,704 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:23,704 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:23,707 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-26 15:55:23,707 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:23,707 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:23,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:23,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:23,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:23,707 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-26 15:55:23,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:23,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:23,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:23,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:23,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:23,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-26 15:55:23,709 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-26 15:55:23,709 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:23,709 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:23,709 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-26 15:55:23,709 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:23,711 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:23,711 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:23,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:23,711 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:23,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:23,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:23,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:23,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:23,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:23,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:23,711 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:23,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:23,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:23,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:23,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:23,714 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:23,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:23,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:23,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:23,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:23,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:23,716 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:23,716 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:23,716 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:23,716 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:23,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-26 15:55:23,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:23,716 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:23,716 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:23,716 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:23,716 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:23,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:23,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:23,716 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:23,716 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:23,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-26 15:55:23,716 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:23,716 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:23,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:23,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:23,817 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:23,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:23,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:23,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:23,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:23,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:23,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-26 15:55:23,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-26 15:55:23,826 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-26 15:55:23,826 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:23,826 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-26 15:55:23,826 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-26 15:55:23,826 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:23,826 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:23,827 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:23,828 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:23,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:23,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:23,828 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:23,828 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:23,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:23,829 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:23,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:23,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:23,829 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-26 15:55:23,830 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-26 15:55:23,830 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-26 15:55:23,830 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-26 15:55:23,830 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:23,830 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-26 15:55:23,830 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:55:23,830 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:55:23,830 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. started... 2023-11-26 15:55:23,830 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. started... 2023-11-26 15:55:23,830 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 26d86fc5d3975b9de436cf03709f95f3 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-26 15:55:23,831 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7b89b16a24fd848ba52ba52ed226f03a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-26 15:55:23,840 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-26 15:55:23,840 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:23,840 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:55:23,840 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. started... 2023-11-26 15:55:23,840 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e0acbef3eb947d2e75284917359a9855 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-26 15:55:23,865 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231126170397f482584b2bbeffc2284607a8a1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231126170397f482584b2bbeffc2284607a8a1 2023-11-26 15:55:24,262 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126ed3a6d44939046b1b8ca94d2cc67baa8 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231126ed3a6d44939046b1b8ca94d2cc67baa8 2023-11-26 15:55:24,262 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112602c745c0127c4cc0b607d87c80598e19 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023112602c745c0127c4cc0b607d87c80598e19 2023-11-26 15:55:24,267 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family1/dcad570e66ab4a73bad6554d2ed1d1f6 2023-11-26 15:55:24,269 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family1/319362e0ae8d4ad0b1e6c42767632010 2023-11-26 15:55:24,667 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family1/3e16559152b740c9bb6f100efd140574 2023-11-26 15:55:24,680 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231126f566cc14a1964aa887f28139fb54e6c2 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231126f566cc14a1964aa887f28139fb54e6c2 2023-11-26 15:55:24,681 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126c7980b87362c42e2adc9263d1942ab3e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231126c7980b87362c42e2adc9263d1942ab3e 2023-11-26 15:55:24,682 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311261161e2e978f743b2baebe79827917a10 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311261161e2e978f743b2baebe79827917a10 2023-11-26 15:55:24,694 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family2/b4f5f98b703b4b928d35bca8212bdc57 2023-11-26 15:55:24,697 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family1/dcad570e66ab4a73bad6554d2ed1d1f6 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/dcad570e66ab4a73bad6554d2ed1d1f6 2023-11-26 15:55:24,704 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/dcad570e66ab4a73bad6554d2ed1d1f6, entries=4, sequenceid=9, filesize=5.4 K 2023-11-26 15:55:24,705 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family2/b4f5f98b703b4b928d35bca8212bdc57 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/b4f5f98b703b4b928d35bca8212bdc57 2023-11-26 15:55:24,708 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/b4f5f98b703b4b928d35bca8212bdc57, entries=2, sequenceid=9, filesize=5.1 K 2023-11-26 15:55:24,709 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 26d86fc5d3975b9de436cf03709f95f3 in 879ms, sequenceid=9, compaction requested=false 2023-11-26 15:55:24,709 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 26d86fc5d3975b9de436cf03709f95f3: 2023-11-26 15:55:24,709 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:55:24,709 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-26 15:55:25,089 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family2/4ab1cd50edc347499cd6ac22da3c43d3 2023-11-26 15:55:25,093 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family2/3ac2d86750de4b85932982557043412f 2023-11-26 15:55:25,094 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family1/319362e0ae8d4ad0b1e6c42767632010 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/319362e0ae8d4ad0b1e6c42767632010 2023-11-26 15:55:25,097 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family1/3e16559152b740c9bb6f100efd140574 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/3e16559152b740c9bb6f100efd140574 2023-11-26 15:55:25,098 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/319362e0ae8d4ad0b1e6c42767632010, entries=4, sequenceid=9, filesize=5.4 K 2023-11-26 15:55:25,099 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family2/4ab1cd50edc347499cd6ac22da3c43d3 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/4ab1cd50edc347499cd6ac22da3c43d3 2023-11-26 15:55:25,101 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/3e16559152b740c9bb6f100efd140574, entries=4, sequenceid=9, filesize=5.4 K 2023-11-26 15:55:25,101 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family2/3ac2d86750de4b85932982557043412f as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/3ac2d86750de4b85932982557043412f 2023-11-26 15:55:25,103 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/4ab1cd50edc347499cd6ac22da3c43d3, entries=2, sequenceid=9, filesize=5.1 K 2023-11-26 15:55:25,103 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for e0acbef3eb947d2e75284917359a9855 in 1263ms, sequenceid=9, compaction requested=false 2023-11-26 15:55:25,103 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e0acbef3eb947d2e75284917359a9855: 2023-11-26 15:55:25,104 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:55:25,104 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-26 15:55:25,105 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/3ac2d86750de4b85932982557043412f, entries=2, sequenceid=9, filesize=5.1 K 2023-11-26 15:55:25,106 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7b89b16a24fd848ba52ba52ed226f03a in 1276ms, sequenceid=9, compaction requested=false 2023-11-26 15:55:25,106 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7b89b16a24fd848ba52ba52ed226f03a: 2023-11-26 15:55:25,106 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:55:25,106 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-26 15:55:25,106 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-26 15:55:25,106 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:25,106 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-26 15:55:25,106 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-26 15:55:25,108 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:25,108 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:25,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:25,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:25,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:25,108 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:25,108 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:25,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:25,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:25,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:25,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:25,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:25,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-26 15:55:25,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20ad2207[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:25,110 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-26 15:55:25,110 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:25,111 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:25,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:25,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:25,112 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-26 15:55:25,112 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-26 15:55:25,112 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:25,112 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:25,112 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:25,113 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-26 15:55:25,113 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:25,113 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:25,113 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-26 15:55:25,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:25,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:25,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:25,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:25,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:25,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:25,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:25,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:25,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:25,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:25,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:25,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-26 15:55:25,116 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-26 15:55:25,116 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:25,116 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:25,116 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-26 15:55:25,116 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:25,117 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:25,117 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:25,117 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:25,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:25,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:25,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:25,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:25,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:25,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:25,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:25,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:25,118 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:25,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:25,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:25,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:25,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:25,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:25,119 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:25,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:25,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:25,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:25,122 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:25,122 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:25,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:25,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:25,122 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:25,122 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:25,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-26 15:55:25,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:25,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-26 15:55:25,122 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:25,122 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:25,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:25,122 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:25,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:25,122 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:25,122 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:25,122 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:25,123 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:25,123 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:25,223 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:25,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:25,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:25,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:25,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:25,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:25,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-26 15:55:25,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-26 15:55:25,229 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-26 15:55:25,229 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:25,229 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-26 15:55:25,229 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-26 15:55:25,230 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:25,230 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:25,231 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:25,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:25,231 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:25,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:25,232 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:25,232 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:25,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:25,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:25,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:25,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:25,233 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-26 15:55:25,233 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-26 15:55:25,233 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-26 15:55:25,233 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-26 15:55:25,233 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:25,233 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-26 15:55:25,233 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:55:25,233 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. started... 2023-11-26 15:55:25,234 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 26d86fc5d3975b9de436cf03709f95f3 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-26 15:55:25,234 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-26 15:55:25,234 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:25,234 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:55:25,234 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:55:25,234 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. started... 2023-11-26 15:55:25,234 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. started... 2023-11-26 15:55:25,234 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7b89b16a24fd848ba52ba52ed226f03a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-26 15:55:25,234 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e0acbef3eb947d2e75284917359a9855 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-26 15:55:25,256 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231126a4e72d5c92a8440286426b76c7d9f2d7 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231126a4e72d5c92a8440286426b76c7d9f2d7 2023-11-26 15:55:25,264 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family1/e4c4ddb2f8194f9a8a00924f0fb08abd 2023-11-26 15:55:25,265 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311266ccc69fa4e204d51a490ea70dcad1a7c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311266ccc69fa4e204d51a490ea70dcad1a7c 2023-11-26 15:55:25,267 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311269015da3b25aa4f7eb27b7871e413d27d to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311269015da3b25aa4f7eb27b7871e413d27d 2023-11-26 15:55:25,272 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family1/2651c680642c42d5bb176014d2a08d44 2023-11-26 15:55:25,282 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231126b1f176e192334bb09ba6e727687f1a6e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231126b1f176e192334bb09ba6e727687f1a6e 2023-11-26 15:55:25,290 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family2/326ad702fea045c9bbeeff948bf3cf6e 2023-11-26 15:55:25,292 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126ab9f5e5e5eb34997b6fa679c2bbf4b51 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231126ab9f5e5e5eb34997b6fa679c2bbf4b51 2023-11-26 15:55:25,305 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family1/e4c4ddb2f8194f9a8a00924f0fb08abd as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/e4c4ddb2f8194f9a8a00924f0fb08abd 2023-11-26 15:55:25,310 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/e4c4ddb2f8194f9a8a00924f0fb08abd, entries=4, sequenceid=13, filesize=5.4 K 2023-11-26 15:55:25,311 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family2/326ad702fea045c9bbeeff948bf3cf6e as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/326ad702fea045c9bbeeff948bf3cf6e 2023-11-26 15:55:25,319 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/326ad702fea045c9bbeeff948bf3cf6e, entries=2, sequenceid=13, filesize=5.1 K 2023-11-26 15:55:25,320 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 26d86fc5d3975b9de436cf03709f95f3 in 86ms, sequenceid=13, compaction requested=true 2023-11-26 15:55:25,320 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 26d86fc5d3975b9de436cf03709f95f3: 2023-11-26 15:55:25,320 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:55:25,320 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-26 15:55:25,675 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family1/95f16d19ff6c494b8ac9154090bc2dd5 2023-11-26 15:55:25,719 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family2/0c5068641aa343c28e8a8cae07fa3d45 2023-11-26 15:55:25,722 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family1/2651c680642c42d5bb176014d2a08d44 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/2651c680642c42d5bb176014d2a08d44 2023-11-26 15:55:25,726 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/2651c680642c42d5bb176014d2a08d44, entries=4, sequenceid=13, filesize=5.4 K 2023-11-26 15:55:25,726 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family2/0c5068641aa343c28e8a8cae07fa3d45 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/0c5068641aa343c28e8a8cae07fa3d45 2023-11-26 15:55:25,730 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/0c5068641aa343c28e8a8cae07fa3d45, entries=2, sequenceid=13, filesize=5.1 K 2023-11-26 15:55:25,731 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7b89b16a24fd848ba52ba52ed226f03a in 497ms, sequenceid=13, compaction requested=true 2023-11-26 15:55:25,731 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7b89b16a24fd848ba52ba52ed226f03a: 2023-11-26 15:55:25,731 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:55:25,731 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-26 15:55:26,090 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112645d580ac34f0495391119028961d9b6b to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023112645d580ac34f0495391119028961d9b6b 2023-11-26 15:55:26,096 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family2/5a751e428ec64eb380acce34454ab33c 2023-11-26 15:55:26,100 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family1/95f16d19ff6c494b8ac9154090bc2dd5 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/95f16d19ff6c494b8ac9154090bc2dd5 2023-11-26 15:55:26,104 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/95f16d19ff6c494b8ac9154090bc2dd5, entries=4, sequenceid=13, filesize=5.4 K 2023-11-26 15:55:26,105 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family2/5a751e428ec64eb380acce34454ab33c as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/5a751e428ec64eb380acce34454ab33c 2023-11-26 15:55:26,109 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/5a751e428ec64eb380acce34454ab33c, entries=2, sequenceid=13, filesize=5.1 K 2023-11-26 15:55:26,110 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for e0acbef3eb947d2e75284917359a9855 in 876ms, sequenceid=13, compaction requested=true 2023-11-26 15:55:26,111 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e0acbef3eb947d2e75284917359a9855: 2023-11-26 15:55:26,111 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:55:26,111 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-26 15:55:26,111 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-26 15:55:26,111 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:26,111 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-26 15:55:26,111 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-26 15:55:26,113 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:26,114 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:26,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:26,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:26,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:26,114 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:26,114 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:26,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:26,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:26,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:26,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:26,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:26,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-26 15:55:26,117 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@437be9cd[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:26,117 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-26 15:55:26,117 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:26,119 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:26,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:26,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:26,119 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-26 15:55:26,119 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-26 15:55:26,119 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:26,119 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:26,119 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:26,121 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-26 15:55:26,121 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:26,121 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:26,121 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-26 15:55:26,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:26,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:26,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:26,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:26,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:26,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:26,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:26,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:26,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:26,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:26,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:26,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-26 15:55:26,124 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-26 15:55:26,124 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:26,124 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:26,124 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-26 15:55:26,124 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:26,128 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:26,128 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:26,128 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:26,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:26,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:26,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:26,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:26,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:26,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:26,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:26,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:26,129 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:26,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:26,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:26,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:26,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:26,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:26,131 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:26,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:26,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:26,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:26,135 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:26,135 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:26,135 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:26,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:26,135 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:26,135 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:26,135 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:26,135 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:26,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-26 15:55:26,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:26,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:26,135 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:26,135 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:26,135 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:26,136 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:26,135 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:26,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:26,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:26,236 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:26,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:26,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:26,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:26,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:26,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:26,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-26 15:55:26,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-26 15:55:26,242 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-26 15:55:26,242 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:26,242 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-26 15:55:26,242 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-26 15:55:26,242 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:26,243 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:26,244 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:26,244 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:26,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:26,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:26,244 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:26,244 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:26,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:26,244 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:26,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:26,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:26,245 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-26 15:55:26,245 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-26 15:55:26,245 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-26 15:55:26,245 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-26 15:55:26,245 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:26,245 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-26 15:55:26,246 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:55:26,246 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:55:26,246 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:55:26,246 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-26 15:55:26,246 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:26,246 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. started... 2023-11-26 15:55:26,246 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. started... 2023-11-26 15:55:26,246 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. started... 2023-11-26 15:55:26,246 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7b89b16a24fd848ba52ba52ed226f03a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-26 15:55:26,246 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e0acbef3eb947d2e75284917359a9855 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-26 15:55:26,246 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 26d86fc5d3975b9de436cf03709f95f3 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-26 15:55:26,256 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231126e55afd285e9a4bb49ffe3c0d2664680c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231126e55afd285e9a4bb49ffe3c0d2664680c 2023-11-26 15:55:26,529 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-26 15:55:26,657 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311264af6fb1e9e4947baad69b9f325338d20 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311264af6fb1e9e4947baad69b9f325338d20 2023-11-26 15:55:26,657 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311262de9f18ba0d74e088a64f101c6a17f3c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311262de9f18ba0d74e088a64f101c6a17f3c 2023-11-26 15:55:26,662 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family1/a8192bbb0e334167926963a8e2ca54b0 2023-11-26 15:55:26,675 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231126f522c2a42ca5446498984c8454fc777f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231126f522c2a42ca5446498984c8454fc777f 2023-11-26 15:55:27,065 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family1/fb80ca676f184f11bdc1db08391609ae 2023-11-26 15:55:27,065 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family1/3889a619e1f9490daae2c8d971f41160 2023-11-26 15:55:27,079 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family2/8291dd3ca7f44708b967468481178c5f 2023-11-26 15:55:27,083 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family1/a8192bbb0e334167926963a8e2ca54b0 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/a8192bbb0e334167926963a8e2ca54b0 2023-11-26 15:55:27,086 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/a8192bbb0e334167926963a8e2ca54b0, entries=4, sequenceid=17, filesize=5.4 K 2023-11-26 15:55:27,086 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family2/8291dd3ca7f44708b967468481178c5f as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/8291dd3ca7f44708b967468481178c5f 2023-11-26 15:55:27,089 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/8291dd3ca7f44708b967468481178c5f, entries=2, sequenceid=17, filesize=5.1 K 2023-11-26 15:55:27,089 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for e0acbef3eb947d2e75284917359a9855 in 843ms, sequenceid=17, compaction requested=true 2023-11-26 15:55:27,090 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e0acbef3eb947d2e75284917359a9855: 2023-11-26 15:55:27,090 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:55:27,090 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-26 15:55:27,478 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231126d4f41c3af18740c6a1444ab59f2fca7e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231126d4f41c3af18740c6a1444ab59f2fca7e 2023-11-26 15:55:27,479 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126ab8c387686b14db8b5b35a2a93d3711e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231126ab8c387686b14db8b5b35a2a93d3711e 2023-11-26 15:55:27,884 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family2/e59877d9d9874bce9b1a3ea5a5382e2b 2023-11-26 15:55:27,884 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family2/a5035c1fec1740a189e7c3ab1dadc0ee 2023-11-26 15:55:27,888 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family1/fb80ca676f184f11bdc1db08391609ae as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/fb80ca676f184f11bdc1db08391609ae 2023-11-26 15:55:27,888 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family1/3889a619e1f9490daae2c8d971f41160 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/3889a619e1f9490daae2c8d971f41160 2023-11-26 15:55:27,891 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/3889a619e1f9490daae2c8d971f41160, entries=4, sequenceid=17, filesize=5.4 K 2023-11-26 15:55:27,892 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/fb80ca676f184f11bdc1db08391609ae, entries=4, sequenceid=17, filesize=5.4 K 2023-11-26 15:55:27,894 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family2/a5035c1fec1740a189e7c3ab1dadc0ee as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/a5035c1fec1740a189e7c3ab1dadc0ee 2023-11-26 15:55:27,894 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family2/e59877d9d9874bce9b1a3ea5a5382e2b as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/e59877d9d9874bce9b1a3ea5a5382e2b 2023-11-26 15:55:27,897 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/a5035c1fec1740a189e7c3ab1dadc0ee, entries=2, sequenceid=17, filesize=5.1 K 2023-11-26 15:55:27,898 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/e59877d9d9874bce9b1a3ea5a5382e2b, entries=2, sequenceid=17, filesize=5.1 K 2023-11-26 15:55:27,898 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7b89b16a24fd848ba52ba52ed226f03a in 1652ms, sequenceid=17, compaction requested=true 2023-11-26 15:55:27,898 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 26d86fc5d3975b9de436cf03709f95f3 in 1652ms, sequenceid=17, compaction requested=true 2023-11-26 15:55:27,898 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7b89b16a24fd848ba52ba52ed226f03a: 2023-11-26 15:55:27,898 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 26d86fc5d3975b9de436cf03709f95f3: 2023-11-26 15:55:27,899 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:55:27,899 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:55:27,899 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-26 15:55:27,899 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-26 15:55:27,899 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-26 15:55:27,899 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:27,899 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-26 15:55:27,899 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-26 15:55:27,904 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:27,904 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:27,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:27,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:27,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:27,904 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:27,904 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:27,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:27,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:27,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:27,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:27,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:27,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-26 15:55:27,906 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@771dc21b[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:27,906 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-26 15:55:27,906 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:27,907 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:27,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-26 15:55:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-26 15:55:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:27,907 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:27,907 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:27,908 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-26 15:55:27,908 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:27,908 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:27,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:27,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:27,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:27,908 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-26 15:55:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:27,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-26 15:55:27,911 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-26 15:55:27,911 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:27,911 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:27,911 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-26 15:55:27,911 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:27,913 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:27,913 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:27,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:27,913 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:27,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:27,913 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:27,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:27,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:27,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:27,914 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:27,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:27,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:27,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:27,918 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:27,918 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:27,918 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:27,918 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:27,918 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:27,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:27,918 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:27,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-26 15:55:27,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:27,918 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:27,918 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:27,918 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:27,918 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:27,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:27,919 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:27,919 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:28,019 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:28,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:28,030 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:55:28,039 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:55:28,048 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:55:28,049 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:55:28,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:28,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-26 15:55:28,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-26 15:55:28,080 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-26 15:55:28,080 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:28,080 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-26 15:55:28,080 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-26 15:55:28,081 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:28,081 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:28,082 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:28,082 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:28,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:28,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:28,083 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:28,083 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:28,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:28,083 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:28,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:28,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:28,084 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-26 15:55:28,084 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-26 15:55:28,084 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-26 15:55:28,084 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-26 15:55:28,084 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:28,084 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-26 15:55:28,086 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:55:28,086 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. started... 2023-11-26 15:55:28,086 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:55:28,086 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-26 15:55:28,086 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:55:28,086 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:28,086 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. started... 2023-11-26 15:55:28,086 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 26d86fc5d3975b9de436cf03709f95f3 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-26 15:55:28,086 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. started... 2023-11-26 15:55:28,086 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7b89b16a24fd848ba52ba52ed226f03a 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-26 15:55:28,086 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e0acbef3eb947d2e75284917359a9855 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-26 15:55:28,512 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family1/22ee9c8816e444c99bac88721d23b543 2023-11-26 15:55:28,515 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22ee9c8816e444c99bac88721d23b543 2023-11-26 15:55:28,911 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family1/baa19f852467455a8774969d062768cf 2023-11-26 15:55:28,911 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family1/ca5accefb26a41df9fc7aad41b142881 2023-11-26 15:55:28,915 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for baa19f852467455a8774969d062768cf 2023-11-26 15:55:28,915 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ca5accefb26a41df9fc7aad41b142881 2023-11-26 15:55:29,329 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family2/6f69529e7e434611aa52093d77596b48 2023-11-26 15:55:29,333 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f69529e7e434611aa52093d77596b48 2023-11-26 15:55:29,333 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family1/22ee9c8816e444c99bac88721d23b543 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/22ee9c8816e444c99bac88721d23b543 2023-11-26 15:55:29,333 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family2/beb8898fa48643c0a04ed527c57b1b85 2023-11-26 15:55:29,336 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for beb8898fa48643c0a04ed527c57b1b85 2023-11-26 15:55:29,337 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22ee9c8816e444c99bac88721d23b543 2023-11-26 15:55:29,337 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/22ee9c8816e444c99bac88721d23b543, entries=3, sequenceid=23, filesize=5.0 K 2023-11-26 15:55:29,337 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family1/ca5accefb26a41df9fc7aad41b142881 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/ca5accefb26a41df9fc7aad41b142881 2023-11-26 15:55:29,338 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family2/6f69529e7e434611aa52093d77596b48 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/6f69529e7e434611aa52093d77596b48 2023-11-26 15:55:29,341 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ca5accefb26a41df9fc7aad41b142881 2023-11-26 15:55:29,341 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/ca5accefb26a41df9fc7aad41b142881, entries=3, sequenceid=23, filesize=5.0 K 2023-11-26 15:55:29,341 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f69529e7e434611aa52093d77596b48 2023-11-26 15:55:29,341 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/6f69529e7e434611aa52093d77596b48, entries=1, sequenceid=23, filesize=5.0 K 2023-11-26 15:55:29,341 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family2/beb8898fa48643c0a04ed527c57b1b85 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/beb8898fa48643c0a04ed527c57b1b85 2023-11-26 15:55:29,342 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 26d86fc5d3975b9de436cf03709f95f3 in 1256ms, sequenceid=23, compaction requested=true 2023-11-26 15:55:29,342 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 26d86fc5d3975b9de436cf03709f95f3: 2023-11-26 15:55:29,342 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:55:29,342 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-26 15:55:29,344 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for beb8898fa48643c0a04ed527c57b1b85 2023-11-26 15:55:29,345 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/beb8898fa48643c0a04ed527c57b1b85, entries=1, sequenceid=23, filesize=5.0 K 2023-11-26 15:55:29,345 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7b89b16a24fd848ba52ba52ed226f03a in 1259ms, sequenceid=23, compaction requested=true 2023-11-26 15:55:29,345 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7b89b16a24fd848ba52ba52ed226f03a: 2023-11-26 15:55:29,345 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:55:29,345 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-26 15:55:29,731 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family2/70540cc98ce643839d11c321bbf0d61a 2023-11-26 15:55:29,734 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 70540cc98ce643839d11c321bbf0d61a 2023-11-26 15:55:29,735 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family1/baa19f852467455a8774969d062768cf as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/baa19f852467455a8774969d062768cf 2023-11-26 15:55:29,738 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for baa19f852467455a8774969d062768cf 2023-11-26 15:55:29,738 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/baa19f852467455a8774969d062768cf, entries=3, sequenceid=23, filesize=5.0 K 2023-11-26 15:55:29,739 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family2/70540cc98ce643839d11c321bbf0d61a as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/70540cc98ce643839d11c321bbf0d61a 2023-11-26 15:55:29,742 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 70540cc98ce643839d11c321bbf0d61a 2023-11-26 15:55:29,742 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/70540cc98ce643839d11c321bbf0d61a, entries=1, sequenceid=23, filesize=5.0 K 2023-11-26 15:55:29,742 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for e0acbef3eb947d2e75284917359a9855 in 1656ms, sequenceid=23, compaction requested=true 2023-11-26 15:55:29,742 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e0acbef3eb947d2e75284917359a9855: 2023-11-26 15:55:29,742 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:55:29,742 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-26 15:55:29,743 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-26 15:55:29,743 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:29,743 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-26 15:55:29,743 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-26 15:55:29,744 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:29,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:29,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:29,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:29,744 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:29,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:29,745 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:29,745 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:29,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:29,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:29,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:29,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:29,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-26 15:55:29,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28a97e28[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:29,746 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-26 15:55:29,746 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:29,748 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:29,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:29,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:29,748 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-26 15:55:29,748 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-26 15:55:29,748 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:29,748 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:29,748 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:29,749 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-26 15:55:29,749 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:29,749 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:29,749 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-26 15:55:29,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:29,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:29,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:29,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:29,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:29,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:29,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:29,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:29,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:29,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:29,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:29,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-26 15:55:29,752 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-26 15:55:29,752 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:29,752 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:29,752 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-26 15:55:29,752 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:29,753 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:29,753 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:29,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:29,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:29,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:29,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:29,753 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:29,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:29,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:29,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:29,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:29,754 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:29,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:29,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:29,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:29,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:29,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:29,755 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:29,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:29,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-26 15:55:29,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:29,757 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:29,757 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:29,757 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:29,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:29,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:29,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-26 15:55:29,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:29,757 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-26 15:55:29,757 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:29,758 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:29,758 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:29,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:29,758 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:29,758 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:29,758 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:29,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:29,758 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-26 15:55:29,758 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-26 15:55:29,858 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:29,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:29,859 DEBUG [Listener at localhost/43645] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-26 15:55:29,859 DEBUG [Listener at localhost/43645] regionserver.HStore(1912): 26d86fc5d3975b9de436cf03709f95f3/family1 is initiating major compaction (all files) 2023-11-26 15:55:29,859 INFO [Listener at localhost/43645] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-26 15:55:29,859 INFO [Listener at localhost/43645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:55:29,860 INFO [Listener at localhost/43645] regionserver.HRegion(2259): Starting compaction of 26d86fc5d3975b9de436cf03709f95f3/family1 in ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:55:29,860 INFO [Listener at localhost/43645] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/86a8fa7541b74913960e55570d5a8444, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/dcad570e66ab4a73bad6554d2ed1d1f6, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/e4c4ddb2f8194f9a8a00924f0fb08abd, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/3889a619e1f9490daae2c8d971f41160, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/22ee9c8816e444c99bac88721d23b543] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp, totalSize=26.6 K 2023-11-26 15:55:29,860 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 86a8fa7541b74913960e55570d5a8444, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014121990 2023-11-26 15:55:29,861 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting dcad570e66ab4a73bad6554d2ed1d1f6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014123819 2023-11-26 15:55:29,861 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting e4c4ddb2f8194f9a8a00924f0fb08abd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014125225 2023-11-26 15:55:29,861 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 3889a619e1f9490daae2c8d971f41160, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014126238 2023-11-26 15:55:29,861 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 22ee9c8816e444c99bac88721d23b543, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-26 15:55:29,872 INFO [Listener at localhost/43645] throttle.PressureAwareThroughputController(145): 26d86fc5d3975b9de436cf03709f95f3#family1#compaction#150 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:30,281 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231126ae1416bfe1cf44c7b8ffef0c20848037_del 2023-11-26 15:55:30,282 INFO [Listener at localhost/43645] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231126ae1416bfe1cf44c7b8ffef0c20848037_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231126ae1416bfe1cf44c7b8ffef0c20848037_del 2023-11-26 15:55:31,095 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 05b411ce9a1a4fb989174f3666eea6f9 2023-11-26 15:55:31,095 DEBUG [Listener at localhost/43645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family1/05b411ce9a1a4fb989174f3666eea6f9 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/05b411ce9a1a4fb989174f3666eea6f9 2023-11-26 15:55:31,098 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 05b411ce9a1a4fb989174f3666eea6f9 2023-11-26 15:55:31,099 INFO [Listener at localhost/43645] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 26d86fc5d3975b9de436cf03709f95f3/family1 of 26d86fc5d3975b9de436cf03709f95f3 into 05b411ce9a1a4fb989174f3666eea6f9(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-26 15:55:31,099 DEBUG [Listener at localhost/43645] regionserver.HRegion(2289): Compaction status journal for 26d86fc5d3975b9de436cf03709f95f3: 2023-11-26 15:55:31,099 DEBUG [Listener at localhost/43645] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-26 15:55:31,099 DEBUG [Listener at localhost/43645] regionserver.HStore(1912): 26d86fc5d3975b9de436cf03709f95f3/family2 is initiating major compaction (all files) 2023-11-26 15:55:31,100 INFO [Listener at localhost/43645] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-26 15:55:31,100 INFO [Listener at localhost/43645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:55:31,100 INFO [Listener at localhost/43645] regionserver.HRegion(2259): Starting compaction of 26d86fc5d3975b9de436cf03709f95f3/family2 in ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:55:31,100 INFO [Listener at localhost/43645] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/bf96c136516846c49cc96ac33d992022, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/b4f5f98b703b4b928d35bca8212bdc57, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/326ad702fea045c9bbeeff948bf3cf6e, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/a5035c1fec1740a189e7c3ab1dadc0ee, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/6f69529e7e434611aa52093d77596b48] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp, totalSize=25.3 K 2023-11-26 15:55:31,100 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting bf96c136516846c49cc96ac33d992022, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014121990 2023-11-26 15:55:31,101 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting b4f5f98b703b4b928d35bca8212bdc57, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014123819 2023-11-26 15:55:31,101 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 326ad702fea045c9bbeeff948bf3cf6e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014125225 2023-11-26 15:55:31,101 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting a5035c1fec1740a189e7c3ab1dadc0ee, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014126238 2023-11-26 15:55:31,101 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 6f69529e7e434611aa52093d77596b48, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-26 15:55:31,109 INFO [Listener at localhost/43645] throttle.PressureAwareThroughputController(145): 26d86fc5d3975b9de436cf03709f95f3#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:31,115 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231126725c4bea2cc94da28dd94b34550c7530_del 2023-11-26 15:55:31,115 INFO [Listener at localhost/43645] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231126725c4bea2cc94da28dd94b34550c7530_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231126725c4bea2cc94da28dd94b34550c7530_del 2023-11-26 15:55:31,148 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/86a8fa7541b74913960e55570d5a8444, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/dcad570e66ab4a73bad6554d2ed1d1f6, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/e4c4ddb2f8194f9a8a00924f0fb08abd, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/3889a619e1f9490daae2c8d971f41160, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/22ee9c8816e444c99bac88721d23b543] to archive 2023-11-26 15:55:31,149 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:31,150 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/86a8fa7541b74913960e55570d5a8444 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/86a8fa7541b74913960e55570d5a8444 2023-11-26 15:55:31,151 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/dcad570e66ab4a73bad6554d2ed1d1f6 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/dcad570e66ab4a73bad6554d2ed1d1f6 2023-11-26 15:55:31,152 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/e4c4ddb2f8194f9a8a00924f0fb08abd to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/e4c4ddb2f8194f9a8a00924f0fb08abd 2023-11-26 15:55:31,153 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/3889a619e1f9490daae2c8d971f41160 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/3889a619e1f9490daae2c8d971f41160 2023-11-26 15:55:31,153 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/22ee9c8816e444c99bac88721d23b543 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/22ee9c8816e444c99bac88721d23b543 2023-11-26 15:55:31,928 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fab215bf6c054a608db1c9051d49aa89 2023-11-26 15:55:31,928 DEBUG [Listener at localhost/43645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/.tmp/family2/fab215bf6c054a608db1c9051d49aa89 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/fab215bf6c054a608db1c9051d49aa89 2023-11-26 15:55:31,932 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fab215bf6c054a608db1c9051d49aa89 2023-11-26 15:55:31,932 INFO [Listener at localhost/43645] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 26d86fc5d3975b9de436cf03709f95f3/family2 of 26d86fc5d3975b9de436cf03709f95f3 into fab215bf6c054a608db1c9051d49aa89(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:55:31,933 DEBUG [Listener at localhost/43645] regionserver.HRegion(2289): Compaction status journal for 26d86fc5d3975b9de436cf03709f95f3: 2023-11-26 15:55:31,933 DEBUG [Listener at localhost/43645] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-26 15:55:31,933 DEBUG [Listener at localhost/43645] regionserver.HStore(1912): 7b89b16a24fd848ba52ba52ed226f03a/family1 is initiating major compaction (all files) 2023-11-26 15:55:31,933 INFO [Listener at localhost/43645] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-26 15:55:31,933 INFO [Listener at localhost/43645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:55:31,933 INFO [Listener at localhost/43645] regionserver.HRegion(2259): Starting compaction of 7b89b16a24fd848ba52ba52ed226f03a/family1 in ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:55:31,933 INFO [Listener at localhost/43645] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/7b2169df66f7413bbc2727d64e1af9d7, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/3e16559152b740c9bb6f100efd140574, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/2651c680642c42d5bb176014d2a08d44, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/fb80ca676f184f11bdc1db08391609ae, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/ca5accefb26a41df9fc7aad41b142881] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp, totalSize=26.6 K 2023-11-26 15:55:31,934 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 7b2169df66f7413bbc2727d64e1af9d7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014121991 2023-11-26 15:55:31,934 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 3e16559152b740c9bb6f100efd140574, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014123819 2023-11-26 15:55:31,934 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 2651c680642c42d5bb176014d2a08d44, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014125225 2023-11-26 15:55:31,935 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting fb80ca676f184f11bdc1db08391609ae, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014126238 2023-11-26 15:55:31,935 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting ca5accefb26a41df9fc7aad41b142881, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-26 15:55:31,944 INFO [Listener at localhost/43645] throttle.PressureAwareThroughputController(145): 7b89b16a24fd848ba52ba52ed226f03a#family1#compaction#152 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:31,946 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/bf96c136516846c49cc96ac33d992022, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/b4f5f98b703b4b928d35bca8212bdc57, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/326ad702fea045c9bbeeff948bf3cf6e, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/a5035c1fec1740a189e7c3ab1dadc0ee, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/6f69529e7e434611aa52093d77596b48] to archive 2023-11-26 15:55:31,947 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:31,949 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/bf96c136516846c49cc96ac33d992022 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/bf96c136516846c49cc96ac33d992022 2023-11-26 15:55:31,950 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/b4f5f98b703b4b928d35bca8212bdc57 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/b4f5f98b703b4b928d35bca8212bdc57 2023-11-26 15:55:31,951 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/326ad702fea045c9bbeeff948bf3cf6e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/326ad702fea045c9bbeeff948bf3cf6e 2023-11-26 15:55:31,952 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/a5035c1fec1740a189e7c3ab1dadc0ee to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/a5035c1fec1740a189e7c3ab1dadc0ee 2023-11-26 15:55:31,953 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/6f69529e7e434611aa52093d77596b48 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family2/6f69529e7e434611aa52093d77596b48 2023-11-26 15:55:32,352 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311262edb3b7b879e4b128499a8e1dd39e55b_del 2023-11-26 15:55:32,353 INFO [Listener at localhost/43645] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311262edb3b7b879e4b128499a8e1dd39e55b_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311262edb3b7b879e4b128499a8e1dd39e55b_del 2023-11-26 15:55:33,166 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 506bc07af17c47cab14f471e5465468f 2023-11-26 15:55:33,167 DEBUG [Listener at localhost/43645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family1/506bc07af17c47cab14f471e5465468f as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/506bc07af17c47cab14f471e5465468f 2023-11-26 15:55:33,171 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 506bc07af17c47cab14f471e5465468f 2023-11-26 15:55:33,172 INFO [Listener at localhost/43645] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7b89b16a24fd848ba52ba52ed226f03a/family1 of 7b89b16a24fd848ba52ba52ed226f03a into 506bc07af17c47cab14f471e5465468f(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-26 15:55:33,172 DEBUG [Listener at localhost/43645] regionserver.HRegion(2289): Compaction status journal for 7b89b16a24fd848ba52ba52ed226f03a: 2023-11-26 15:55:33,172 DEBUG [Listener at localhost/43645] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-26 15:55:33,172 DEBUG [Listener at localhost/43645] regionserver.HStore(1912): 7b89b16a24fd848ba52ba52ed226f03a/family2 is initiating major compaction (all files) 2023-11-26 15:55:33,172 INFO [Listener at localhost/43645] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-26 15:55:33,172 INFO [Listener at localhost/43645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:55:33,173 INFO [Listener at localhost/43645] regionserver.HRegion(2259): Starting compaction of 7b89b16a24fd848ba52ba52ed226f03a/family2 in ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:55:33,173 INFO [Listener at localhost/43645] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/0cf7dd34134049649103f9fa9afa81b5, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/3ac2d86750de4b85932982557043412f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/0c5068641aa343c28e8a8cae07fa3d45, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/e59877d9d9874bce9b1a3ea5a5382e2b, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/beb8898fa48643c0a04ed527c57b1b85] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp, totalSize=25.3 K 2023-11-26 15:55:33,174 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 0cf7dd34134049649103f9fa9afa81b5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014121991 2023-11-26 15:55:33,174 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 3ac2d86750de4b85932982557043412f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014123819 2023-11-26 15:55:33,174 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 0c5068641aa343c28e8a8cae07fa3d45, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014125225 2023-11-26 15:55:33,175 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting e59877d9d9874bce9b1a3ea5a5382e2b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014126238 2023-11-26 15:55:33,175 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting beb8898fa48643c0a04ed527c57b1b85, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-26 15:55:33,183 INFO [Listener at localhost/43645] throttle.PressureAwareThroughputController(145): 7b89b16a24fd848ba52ba52ed226f03a#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:33,249 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/7b2169df66f7413bbc2727d64e1af9d7, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/3e16559152b740c9bb6f100efd140574, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/2651c680642c42d5bb176014d2a08d44, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/fb80ca676f184f11bdc1db08391609ae, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/ca5accefb26a41df9fc7aad41b142881] to archive 2023-11-26 15:55:33,249 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:33,251 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/7b2169df66f7413bbc2727d64e1af9d7 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/7b2169df66f7413bbc2727d64e1af9d7 2023-11-26 15:55:33,252 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/3e16559152b740c9bb6f100efd140574 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/3e16559152b740c9bb6f100efd140574 2023-11-26 15:55:33,253 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/2651c680642c42d5bb176014d2a08d44 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/2651c680642c42d5bb176014d2a08d44 2023-11-26 15:55:33,254 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/fb80ca676f184f11bdc1db08391609ae to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/fb80ca676f184f11bdc1db08391609ae 2023-11-26 15:55:33,254 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/ca5accefb26a41df9fc7aad41b142881 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/ca5accefb26a41df9fc7aad41b142881 2023-11-26 15:55:33,591 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231126edc1fd7ea8e746cfa953bcc867c4eda5_del 2023-11-26 15:55:33,591 INFO [Listener at localhost/43645] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126edc1fd7ea8e746cfa953bcc867c4eda5_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231126edc1fd7ea8e746cfa953bcc867c4eda5_del 2023-11-26 15:55:34,405 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5efe4cc0acc74df383dd4d603e605711 2023-11-26 15:55:34,406 DEBUG [Listener at localhost/43645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/.tmp/family2/5efe4cc0acc74df383dd4d603e605711 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/5efe4cc0acc74df383dd4d603e605711 2023-11-26 15:55:34,410 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5efe4cc0acc74df383dd4d603e605711 2023-11-26 15:55:34,411 INFO [Listener at localhost/43645] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7b89b16a24fd848ba52ba52ed226f03a/family2 of 7b89b16a24fd848ba52ba52ed226f03a into 5efe4cc0acc74df383dd4d603e605711(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-26 15:55:34,411 DEBUG [Listener at localhost/43645] regionserver.HRegion(2289): Compaction status journal for 7b89b16a24fd848ba52ba52ed226f03a: 2023-11-26 15:55:34,411 DEBUG [Listener at localhost/43645] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-26 15:55:34,411 DEBUG [Listener at localhost/43645] regionserver.HStore(1912): e0acbef3eb947d2e75284917359a9855/family1 is initiating major compaction (all files) 2023-11-26 15:55:34,411 INFO [Listener at localhost/43645] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-26 15:55:34,411 INFO [Listener at localhost/43645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:55:34,411 INFO [Listener at localhost/43645] regionserver.HRegion(2259): Starting compaction of e0acbef3eb947d2e75284917359a9855/family1 in ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:55:34,411 INFO [Listener at localhost/43645] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/a47df657da7345c0a571ad2fe0e3a5bb, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/319362e0ae8d4ad0b1e6c42767632010, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/95f16d19ff6c494b8ac9154090bc2dd5, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/a8192bbb0e334167926963a8e2ca54b0, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/baa19f852467455a8774969d062768cf] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp, totalSize=26.6 K 2023-11-26 15:55:34,412 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting a47df657da7345c0a571ad2fe0e3a5bb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014121989 2023-11-26 15:55:34,412 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 319362e0ae8d4ad0b1e6c42767632010, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014123819 2023-11-26 15:55:34,412 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 95f16d19ff6c494b8ac9154090bc2dd5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014125224 2023-11-26 15:55:34,413 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting a8192bbb0e334167926963a8e2ca54b0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014126237 2023-11-26 15:55:34,413 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting baa19f852467455a8774969d062768cf, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-26 15:55:34,420 INFO [Listener at localhost/43645] throttle.PressureAwareThroughputController(145): e0acbef3eb947d2e75284917359a9855#family1#compaction#154 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:34,447 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/0cf7dd34134049649103f9fa9afa81b5, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/3ac2d86750de4b85932982557043412f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/0c5068641aa343c28e8a8cae07fa3d45, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/e59877d9d9874bce9b1a3ea5a5382e2b, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/beb8898fa48643c0a04ed527c57b1b85] to archive 2023-11-26 15:55:34,447 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:34,449 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/0cf7dd34134049649103f9fa9afa81b5 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/0cf7dd34134049649103f9fa9afa81b5 2023-11-26 15:55:34,450 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/3ac2d86750de4b85932982557043412f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/3ac2d86750de4b85932982557043412f 2023-11-26 15:55:34,452 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/0c5068641aa343c28e8a8cae07fa3d45 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/0c5068641aa343c28e8a8cae07fa3d45 2023-11-26 15:55:34,453 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/e59877d9d9874bce9b1a3ea5a5382e2b to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/e59877d9d9874bce9b1a3ea5a5382e2b 2023-11-26 15:55:34,454 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/beb8898fa48643c0a04ed527c57b1b85 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family2/beb8898fa48643c0a04ed527c57b1b85 2023-11-26 15:55:34,827 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231126b2a84d0f816d48a1b255a808c4134fa0_del 2023-11-26 15:55:34,827 INFO [Listener at localhost/43645] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231126b2a84d0f816d48a1b255a808c4134fa0_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231126b2a84d0f816d48a1b255a808c4134fa0_del 2023-11-26 15:55:35,641 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 34ba637bb53a4055a03992acb0c61202 2023-11-26 15:55:35,642 DEBUG [Listener at localhost/43645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family1/34ba637bb53a4055a03992acb0c61202 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/34ba637bb53a4055a03992acb0c61202 2023-11-26 15:55:35,646 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 34ba637bb53a4055a03992acb0c61202 2023-11-26 15:55:35,647 INFO [Listener at localhost/43645] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e0acbef3eb947d2e75284917359a9855/family1 of e0acbef3eb947d2e75284917359a9855 into 34ba637bb53a4055a03992acb0c61202(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-26 15:55:35,648 DEBUG [Listener at localhost/43645] regionserver.HRegion(2289): Compaction status journal for e0acbef3eb947d2e75284917359a9855: 2023-11-26 15:55:35,648 DEBUG [Listener at localhost/43645] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-26 15:55:35,648 DEBUG [Listener at localhost/43645] regionserver.HStore(1912): e0acbef3eb947d2e75284917359a9855/family2 is initiating major compaction (all files) 2023-11-26 15:55:35,648 INFO [Listener at localhost/43645] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-26 15:55:35,648 INFO [Listener at localhost/43645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:55:35,649 INFO [Listener at localhost/43645] regionserver.HRegion(2259): Starting compaction of e0acbef3eb947d2e75284917359a9855/family2 in ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:55:35,649 INFO [Listener at localhost/43645] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/39ba1e00740746c09ba352cfddabc140, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/4ab1cd50edc347499cd6ac22da3c43d3, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/5a751e428ec64eb380acce34454ab33c, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/8291dd3ca7f44708b967468481178c5f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/70540cc98ce643839d11c321bbf0d61a] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp, totalSize=25.3 K 2023-11-26 15:55:35,650 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 39ba1e00740746c09ba352cfddabc140, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014121989 2023-11-26 15:55:35,650 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 4ab1cd50edc347499cd6ac22da3c43d3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014123819 2023-11-26 15:55:35,651 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 5a751e428ec64eb380acce34454ab33c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014125224 2023-11-26 15:55:35,651 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 8291dd3ca7f44708b967468481178c5f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014126237 2023-11-26 15:55:35,651 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 70540cc98ce643839d11c321bbf0d61a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-26 15:55:35,661 INFO [Listener at localhost/43645] throttle.PressureAwareThroughputController(145): e0acbef3eb947d2e75284917359a9855#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:35,747 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/a47df657da7345c0a571ad2fe0e3a5bb, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/319362e0ae8d4ad0b1e6c42767632010, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/95f16d19ff6c494b8ac9154090bc2dd5, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/a8192bbb0e334167926963a8e2ca54b0, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/baa19f852467455a8774969d062768cf] to archive 2023-11-26 15:55:35,747 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:35,749 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/a47df657da7345c0a571ad2fe0e3a5bb to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/a47df657da7345c0a571ad2fe0e3a5bb 2023-11-26 15:55:35,750 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/319362e0ae8d4ad0b1e6c42767632010 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/319362e0ae8d4ad0b1e6c42767632010 2023-11-26 15:55:35,751 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/95f16d19ff6c494b8ac9154090bc2dd5 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/95f16d19ff6c494b8ac9154090bc2dd5 2023-11-26 15:55:35,752 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/a8192bbb0e334167926963a8e2ca54b0 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/a8192bbb0e334167926963a8e2ca54b0 2023-11-26 15:55:35,752 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/baa19f852467455a8774969d062768cf to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/baa19f852467455a8774969d062768cf 2023-11-26 15:55:36,073 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231126d7949049471440848e685c5c67d047e2_del 2023-11-26 15:55:36,073 INFO [Listener at localhost/43645] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231126d7949049471440848e685c5c67d047e2_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231126d7949049471440848e685c5c67d047e2_del 2023-11-26 15:55:36,886 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26ddf42b9db64c45a206833327afe442 2023-11-26 15:55:36,887 DEBUG [Listener at localhost/43645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/.tmp/family2/26ddf42b9db64c45a206833327afe442 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/26ddf42b9db64c45a206833327afe442 2023-11-26 15:55:36,891 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26ddf42b9db64c45a206833327afe442 2023-11-26 15:55:36,892 INFO [Listener at localhost/43645] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e0acbef3eb947d2e75284917359a9855/family2 of e0acbef3eb947d2e75284917359a9855 into 26ddf42b9db64c45a206833327afe442(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-26 15:55:36,892 DEBUG [Listener at localhost/43645] regionserver.HRegion(2289): Compaction status journal for e0acbef3eb947d2e75284917359a9855: 2023-11-26 15:55:36,895 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:55:36,898 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:55:36,901 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:55:36,902 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:55:36,906 INFO [Listener at localhost/43645] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-26 15:55:36,918 INFO [Listener at localhost/43645] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-11-26 15:55:36,920 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231126b2a84d0f816d48a1b255a808c4134fa0_del 2023-11-26 15:55:36,922 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231126ae1416bfe1cf44c7b8ffef0c20848037_del 2023-11-26 15:55:36,925 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311262edb3b7b879e4b128499a8e1dd39e55b_del 2023-11-26 15:55:36,925 INFO [Listener at localhost/43645] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-11-26 15:55:36,926 DEBUG [Listener at localhost/43645] zookeeper.ReadOnlyZKClient(139): Connect 0x06c8f92a to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:55:36,930 DEBUG [Listener at localhost/43645] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20748126, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:55:36,931 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231126 for table='ns:testMinorCompaction' and column='family1' 2023-11-26 15:55:36,931 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231126 for table='ns:testMinorCompaction' and column='family1' 2023-11-26 15:55:36,931 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231126 for table='ns:testMinorCompaction' and column='family1' 2023-11-26 15:55:36,951 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/39ba1e00740746c09ba352cfddabc140, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/4ab1cd50edc347499cd6ac22da3c43d3, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/5a751e428ec64eb380acce34454ab33c, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/8291dd3ca7f44708b967468481178c5f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/70540cc98ce643839d11c321bbf0d61a] to archive 2023-11-26 15:55:36,952 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:36,953 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/39ba1e00740746c09ba352cfddabc140 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/39ba1e00740746c09ba352cfddabc140 2023-11-26 15:55:36,954 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/4ab1cd50edc347499cd6ac22da3c43d3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/4ab1cd50edc347499cd6ac22da3c43d3 2023-11-26 15:55:36,955 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/5a751e428ec64eb380acce34454ab33c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/5a751e428ec64eb380acce34454ab33c 2023-11-26 15:55:36,956 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/8291dd3ca7f44708b967468481178c5f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/8291dd3ca7f44708b967468481178c5f 2023-11-26 15:55:36,957 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/70540cc98ce643839d11c321bbf0d61a to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family2/70540cc98ce643839d11c321bbf0d61a 2023-11-26 15:55:37,363 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231126b6b1e1f120194a7499a5ea8ba68886fd to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231126b6b1e1f120194a7499a5ea8ba68886fd 2023-11-26 15:55:37,364 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231126 table='ns:testMinorCompaction' column='family1' 2023-11-26 15:55:37,377 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:55:37,382 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58288, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:55:37,396 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-26 15:55:37,399 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49676, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-26 15:55:37,414 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231126/family1/bedbe337df1d4609a7da4882a20b9fe0 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-11-26 15:55:37,414 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231126/family1/bedbe337df1d4609a7da4882a20b9fe0}] 2023-11-26 15:55:37,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231126/family1/bedbe337df1d4609a7da4882a20b9fe0 for inclusion in 26d86fc5d3975b9de436cf03709f95f3/family1 2023-11-26 15:55:37,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-11-26 15:55:37,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-26 15:55:37,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for 26d86fc5d3975b9de436cf03709f95f3: 2023-11-26 15:55:37,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231126/family1/bedbe337df1d4609a7da4882a20b9fe0 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__ns_testMinorCompaction__90ji63vb9f95v9n4qjam7tvu9gkmgg7b4jbdni9mivgr1ebu5pplf52a6302oo2l/family1/bedbe337df1d4609a7da4882a20b9fe0 2023-11-26 15:55:37,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__ns_testMinorCompaction__90ji63vb9f95v9n4qjam7tvu9gkmgg7b4jbdni9mivgr1ebu5pplf52a6302oo2l/family1/bedbe337df1d4609a7da4882a20b9fe0 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/eb24d0f1ad034f6493f6cb2a286e2bd3_SeqId_28_ 2023-11-26 15:55:37,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__ns_testMinorCompaction__90ji63vb9f95v9n4qjam7tvu9gkmgg7b4jbdni9mivgr1ebu5pplf52a6302oo2l/family1/bedbe337df1d4609a7da4882a20b9fe0 into 26d86fc5d3975b9de436cf03709f95f3/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/eb24d0f1ad034f6493f6cb2a286e2bd3_SeqId_28_ - updating store file list. 2023-11-26 15:55:37,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/eb24d0f1ad034f6493f6cb2a286e2bd3_SeqId_28_ into 26d86fc5d3975b9de436cf03709f95f3/family1 2023-11-26 15:55:37,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__ns_testMinorCompaction__90ji63vb9f95v9n4qjam7tvu9gkmgg7b4jbdni9mivgr1ebu5pplf52a6302oo2l/family1/bedbe337df1d4609a7da4882a20b9fe0 into 26d86fc5d3975b9de436cf03709f95f3/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/family1/eb24d0f1ad034f6493f6cb2a286e2bd3_SeqId_28_) 2023-11-26 15:55:37,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__ns_testMinorCompaction__90ji63vb9f95v9n4qjam7tvu9gkmgg7b4jbdni9mivgr1ebu5pplf52a6302oo2l/family1/bedbe337df1d4609a7da4882a20b9fe0 2023-11-26 15:55:37,431 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231126 table='ns:testMinorCompaction' column='family1' 2023-11-26 15:55:37,432 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:37,433 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231126c1cdedd7d92248dbbd8f1c1ad4b565e7 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231126c1cdedd7d92248dbbd8f1c1ad4b565e7 2023-11-26 15:55:37,433 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-26 15:55:37,433 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231126' 2023-11-26 15:55:37,434 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231126 for table='ns:testMinorCompaction' and column='family1' 2023-11-26 15:55:37,764 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231126671c049e67c74a3eb4040549e926b104 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231126671c049e67c74a3eb4040549e926b104 2023-11-26 15:55:37,764 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126769ebcf80f6648b89690a99f70afc3a0 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231126769ebcf80f6648b89690a99f70afc3a0 2023-11-26 15:55:37,765 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231126 table='ns:testMinorCompaction' column='family1' 2023-11-26 15:55:37,765 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231126 table='ns:testMinorCompaction' column='family1' 2023-11-26 15:55:37,789 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231126/family1/54acbf1ea4154f0e94363facf8551dfc first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-11-26 15:55:37,790 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231126/family1/54acbf1ea4154f0e94363facf8551dfc}] 2023-11-26 15:55:37,792 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231126/family1/965655f229864323adc4e08c75d91e86 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-11-26 15:55:37,792 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231126/family1/965655f229864323adc4e08c75d91e86}] 2023-11-26 15:55:37,794 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231126/family1/54acbf1ea4154f0e94363facf8551dfc for inclusion in 7b89b16a24fd848ba52ba52ed226f03a/family1 2023-11-26 15:55:37,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231126/family1/965655f229864323adc4e08c75d91e86 for inclusion in e0acbef3eb947d2e75284917359a9855/family1 2023-11-26 15:55:37,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-11-26 15:55:37,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-26 15:55:37,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-11-26 15:55:37,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for 7b89b16a24fd848ba52ba52ed226f03a: 2023-11-26 15:55:37,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last=1 2023-11-26 15:55:37,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for e0acbef3eb947d2e75284917359a9855: 2023-11-26 15:55:37,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231126/family1/965655f229864323adc4e08c75d91e86 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__ns_testMinorCompaction__1f7csvp0hhsfihvqc4badi6gr236fdv9dgrtug9hulsd8i4p6mu5sfd9t7l8dnl/family1/965655f229864323adc4e08c75d91e86 2023-11-26 15:55:37,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231126/family1/54acbf1ea4154f0e94363facf8551dfc to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__ns_testMinorCompaction__f3hs42se6o8gg0me8csatjpf24bvgrp3r0o2q7gfft3l8tp6vtfop9311k0066cp/family1/54acbf1ea4154f0e94363facf8551dfc 2023-11-26 15:55:37,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__ns_testMinorCompaction__1f7csvp0hhsfihvqc4badi6gr236fdv9dgrtug9hulsd8i4p6mu5sfd9t7l8dnl/family1/965655f229864323adc4e08c75d91e86 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/49397fae5d5b4956b63a791f7dc11685_SeqId_28_ 2023-11-26 15:55:37,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__ns_testMinorCompaction__f3hs42se6o8gg0me8csatjpf24bvgrp3r0o2q7gfft3l8tp6vtfop9311k0066cp/family1/54acbf1ea4154f0e94363facf8551dfc as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/e384e745ae5e4ee29e5c9a10e5160bb3_SeqId_28_ 2023-11-26 15:55:37,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__ns_testMinorCompaction__1f7csvp0hhsfihvqc4badi6gr236fdv9dgrtug9hulsd8i4p6mu5sfd9t7l8dnl/family1/965655f229864323adc4e08c75d91e86 into e0acbef3eb947d2e75284917359a9855/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/49397fae5d5b4956b63a791f7dc11685_SeqId_28_ - updating store file list. 2023-11-26 15:55:37,800 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__ns_testMinorCompaction__f3hs42se6o8gg0me8csatjpf24bvgrp3r0o2q7gfft3l8tp6vtfop9311k0066cp/family1/54acbf1ea4154f0e94363facf8551dfc into 7b89b16a24fd848ba52ba52ed226f03a/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/e384e745ae5e4ee29e5c9a10e5160bb3_SeqId_28_ - updating store file list. 2023-11-26 15:55:37,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/49397fae5d5b4956b63a791f7dc11685_SeqId_28_ into e0acbef3eb947d2e75284917359a9855/family1 2023-11-26 15:55:37,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__ns_testMinorCompaction__1f7csvp0hhsfihvqc4badi6gr236fdv9dgrtug9hulsd8i4p6mu5sfd9t7l8dnl/family1/965655f229864323adc4e08c75d91e86 into e0acbef3eb947d2e75284917359a9855/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/family1/49397fae5d5b4956b63a791f7dc11685_SeqId_28_) 2023-11-26 15:55:37,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__ns_testMinorCompaction__1f7csvp0hhsfihvqc4badi6gr236fdv9dgrtug9hulsd8i4p6mu5sfd9t7l8dnl/family1/965655f229864323adc4e08c75d91e86 2023-11-26 15:55:37,803 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/e384e745ae5e4ee29e5c9a10e5160bb3_SeqId_28_ into 7b89b16a24fd848ba52ba52ed226f03a/family1 2023-11-26 15:55:37,804 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__ns_testMinorCompaction__f3hs42se6o8gg0me8csatjpf24bvgrp3r0o2q7gfft3l8tp6vtfop9311k0066cp/family1/54acbf1ea4154f0e94363facf8551dfc into 7b89b16a24fd848ba52ba52ed226f03a/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/family1/e384e745ae5e4ee29e5c9a10e5160bb3_SeqId_28_) 2023-11-26 15:55:37,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__ns_testMinorCompaction__f3hs42se6o8gg0me8csatjpf24bvgrp3r0o2q7gfft3l8tp6vtfop9311k0066cp/family1/54acbf1ea4154f0e94363facf8551dfc 2023-11-26 15:55:37,805 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231126 table='ns:testMinorCompaction' column='family1' 2023-11-26 15:55:37,805 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:37,805 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231126 table='ns:testMinorCompaction' column='family1' 2023-11-26 15:55:37,806 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:37,807 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023112650dae547214c4b8bbbf7ec543ef82825 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023112650dae547214c4b8bbbf7ec543ef82825 2023-11-26 15:55:37,807 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-26 15:55:37,807 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231126' 2023-11-26 15:55:37,807 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231126fb8be066efea468b80b4e88d842aa4e4 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231126fb8be066efea468b80b4e88d842aa4e4 2023-11-26 15:55:37,807 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231126 for table='ns:testMinorCompaction' and column='family1' 2023-11-26 15:55:37,807 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-26 15:55:37,807 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231126' 2023-11-26 15:55:37,807 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231126 for table='ns:testMinorCompaction' and column='family1' 2023-11-26 15:55:37,808 INFO [Listener at localhost/43645] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-11-26 15:55:37,809 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:55:37,811 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:55:37,814 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:55:37,814 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:55:37,834 INFO [Listener at localhost/43645] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=251 (was 289), OpenFileDescriptor=661 (was 797), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=200 (was 198) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 169), AvailableMemoryMB=8122 (was 8800) 2023-11-26 15:55:37,845 INFO [Listener at localhost/43645] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=251, OpenFileDescriptor=661, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=168, AvailableMemoryMB=8121 2023-11-26 15:55:37,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-26 15:55:37,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:37,848 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-26 15:55:37,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-11-26 15:55:37,849 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-26 15:55:37,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-26 15:55:37,850 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a 2023-11-26 15:55:37,850 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a empty. 2023-11-26 15:55:37,850 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a 2023-11-26 15:55:37,850 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-11-26 15:55:37,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-26 15:55:38,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-26 15:55:38,257 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-26 15:55:38,258 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => f129063d34c7e932fc424e95e294be7a, NAME => 'testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:55:38,262 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:55:38,263 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing f129063d34c7e932fc424e95e294be7a, disabling compactions & flushes 2023-11-26 15:55:38,263 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:38,263 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:38,263 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. after waiting 0 ms 2023-11-26 15:55:38,263 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:38,263 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:38,263 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for f129063d34c7e932fc424e95e294be7a: 2023-11-26 15:55:38,264 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-26 15:55:38,265 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701014138265"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014138265"}]},"ts":"1701014138265"} 2023-11-26 15:55:38,267 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-26 15:55:38,267 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-26 15:55:38,267 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014138267"}]},"ts":"1701014138267"} 2023-11-26 15:55:38,268 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-26 15:55:38,272 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=f129063d34c7e932fc424e95e294be7a, ASSIGN}] 2023-11-26 15:55:38,273 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=f129063d34c7e932fc424e95e294be7a, ASSIGN 2023-11-26 15:55:38,273 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=f129063d34c7e932fc424e95e294be7a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:55:38,424 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=f129063d34c7e932fc424e95e294be7a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:38,425 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701014138424"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014138424"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014138424"}]},"ts":"1701014138424"} 2023-11-26 15:55:38,426 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure f129063d34c7e932fc424e95e294be7a, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:55:38,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-26 15:55:38,577 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:38,580 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:38,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f129063d34c7e932fc424e95e294be7a, NAME => 'testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a.', STARTKEY => '', ENDKEY => ''} 2023-11-26 15:55:38,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy f129063d34c7e932fc424e95e294be7a 2023-11-26 15:55:38,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:55:38,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f129063d34c7e932fc424e95e294be7a 2023-11-26 15:55:38,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f129063d34c7e932fc424e95e294be7a 2023-11-26 15:55:38,581 INFO [StoreOpener-f129063d34c7e932fc424e95e294be7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f129063d34c7e932fc424e95e294be7a 2023-11-26 15:55:38,582 DEBUG [StoreOpener-f129063d34c7e932fc424e95e294be7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1 2023-11-26 15:55:38,582 DEBUG [StoreOpener-f129063d34c7e932fc424e95e294be7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1 2023-11-26 15:55:38,583 INFO [StoreOpener-f129063d34c7e932fc424e95e294be7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f129063d34c7e932fc424e95e294be7a columnFamilyName family1 2023-11-26 15:55:38,584 INFO [StoreOpener-f129063d34c7e932fc424e95e294be7a-1] regionserver.HStore(310): Store=f129063d34c7e932fc424e95e294be7a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:55:38,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a 2023-11-26 15:55:38,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a 2023-11-26 15:55:38,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f129063d34c7e932fc424e95e294be7a 2023-11-26 15:55:38,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:55:38,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f129063d34c7e932fc424e95e294be7a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74267257, jitterRate=0.1066683679819107}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-26 15:55:38,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f129063d34c7e932fc424e95e294be7a: 2023-11-26 15:55:38,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a., pid=114, masterSystemTime=1701014138577 2023-11-26 15:55:38,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:38,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:38,591 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=f129063d34c7e932fc424e95e294be7a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:38,591 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701014138591"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014138591"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014138591"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014138591"}]},"ts":"1701014138591"} 2023-11-26 15:55:38,594 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=114, resume processing ppid=113 2023-11-26 15:55:38,594 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure f129063d34c7e932fc424e95e294be7a, server=jenkins-hbase4.apache.org,41861,1701014000937 in 166 msec 2023-11-26 15:55:38,595 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=113, resume processing ppid=112 2023-11-26 15:55:38,595 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=f129063d34c7e932fc424e95e294be7a, ASSIGN in 322 msec 2023-11-26 15:55:38,596 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-26 15:55:38,596 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014138596"}]},"ts":"1701014138596"} 2023-11-26 15:55:38,597 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-26 15:55:38,599 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-26 15:55:38,601 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 753 msec 2023-11-26 15:55:38,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-26 15:55:38,953 INFO [Listener at localhost/43645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-11-26 15:55:38,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:38,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:38,975 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:38,975 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:38,976 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-26 15:55:38,976 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-26 15:55:38,976 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:38,976 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:38,977 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:38,977 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:38,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:38,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:38,978 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:38,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:38,978 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:38,978 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:38,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:38,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:38,979 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:38,979 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:38,979 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-26 15:55:38,979 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:38,979 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-26 15:55:38,979 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:55:38,979 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:38,979 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:38,979 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. started... 2023-11-26 15:55:38,980 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f129063d34c7e932fc424e95e294be7a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-26 15:55:39,398 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b42b4f2aea814d37a3498b5d8a0dad8d to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130b42b4f2aea814d37a3498b5d8a0dad8d 2023-11-26 15:55:39,801 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/c89118ff3eb94597b77436daa2f26cc1 2023-11-26 15:55:39,806 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/c89118ff3eb94597b77436daa2f26cc1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/c89118ff3eb94597b77436daa2f26cc1 2023-11-26 15:55:39,809 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/c89118ff3eb94597b77436daa2f26cc1, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-26 15:55:39,809 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f129063d34c7e932fc424e95e294be7a in 829ms, sequenceid=5, compaction requested=false 2023-11-26 15:55:39,809 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:39,810 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f129063d34c7e932fc424e95e294be7a: 2023-11-26 15:55:39,810 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:39,810 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:55:39,810 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:55:39,810 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,810 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-26 15:55:39,810 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-26 15:55:39,814 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,814 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:39,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:39,814 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,815 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:39,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:39,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:39,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:39,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-26 15:55:39,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@615dcc20[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:39,816 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-26 15:55:39,816 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,817 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,817 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-26 15:55:39,818 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-26 15:55:39,818 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:39,818 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,818 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:39,819 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-26 15:55:39,819 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,819 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:39,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:39,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:39,819 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-26 15:55:39,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:39,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:39,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:39,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:39,821 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:55:39,821 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-26 15:55:39,822 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:39,822 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:39,822 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,822 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:39,824 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,824 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:39,824 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:39,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:39,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:39,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:39,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:39,825 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:39,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,826 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:39,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,828 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,828 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,828 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,828 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:39,829 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:39,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:39,829 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,829 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:39,829 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:39,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:39,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:39,829 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,829 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:39,829 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,829 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:39,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:39,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:39,929 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:39,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:39,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:39,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:55:39,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,936 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:39,936 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:39,936 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-26 15:55:39,936 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-26 15:55:39,936 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,937 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,938 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,938 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:39,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:39,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:39,938 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,938 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:39,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:39,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,939 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,940 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-26 15:55:39,940 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,940 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-26 15:55:39,940 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:39,940 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-26 15:55:39,940 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:55:39,940 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:39,940 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:39,940 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. started... 2023-11-26 15:55:39,940 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f129063d34c7e932fc424e95e294be7a 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-26 15:55:39,951 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112882988963cea947c681ef31c7f8dd62b4 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112882988963cea947c681ef31c7f8dd62b4 2023-11-26 15:55:39,956 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/63e87e61c57a4c3f87d081e92e50f3d3 2023-11-26 15:55:39,960 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/63e87e61c57a4c3f87d081e92e50f3d3 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/63e87e61c57a4c3f87d081e92e50f3d3 2023-11-26 15:55:39,963 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/63e87e61c57a4c3f87d081e92e50f3d3, entries=1, sequenceid=9, filesize=5.0 K 2023-11-26 15:55:39,964 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f129063d34c7e932fc424e95e294be7a in 24ms, sequenceid=9, compaction requested=false 2023-11-26 15:55:39,964 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f129063d34c7e932fc424e95e294be7a: 2023-11-26 15:55:39,964 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:39,964 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:55:39,964 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:55:39,964 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,965 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-26 15:55:39,965 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-26 15:55:39,966 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,966 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:39,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:39,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:39,967 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,967 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:39,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:39,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:39,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-26 15:55:39,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7df46447[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:39,968 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-26 15:55:39,968 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,970 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,970 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-26 15:55:39,970 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-26 15:55:39,970 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,970 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:39,970 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:39,971 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-26 15:55:39,971 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,972 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:39,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:39,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:39,972 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-26 15:55:39,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:39,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:39,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:39,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:39,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:55:39,974 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-26 15:55:39,974 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:39,974 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:39,974 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,974 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:39,975 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,975 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,975 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:39,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:39,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:39,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:39,976 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:39,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:39,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,977 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:39,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,979 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,979 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,979 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:39,979 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:39,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:39,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:39,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:39,979 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:39,979 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:39,979 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:39,979 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:39,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-26 15:55:39,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:39,980 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:39,980 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:39,980 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:39,981 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,081 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:40,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:40,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:40,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:55:40,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,086 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:40,086 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:40,086 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-26 15:55:40,086 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-26 15:55:40,087 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,087 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,089 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:40,089 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:40,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:40,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:40,089 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:40,089 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:40,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:40,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,090 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,090 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-26 15:55:40,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,090 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-26 15:55:40,090 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:40,090 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-26 15:55:40,092 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:55:40,092 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:40,092 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:40,092 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. started... 2023-11-26 15:55:40,092 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f129063d34c7e932fc424e95e294be7a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:55:40,504 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201fa69d4ea95264167be3856844056b2d0 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201fa69d4ea95264167be3856844056b2d0 2023-11-26 15:55:40,909 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/0c971c859562455b98d919da8e1ea28b 2023-11-26 15:55:40,913 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/0c971c859562455b98d919da8e1ea28b as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/0c971c859562455b98d919da8e1ea28b 2023-11-26 15:55:40,917 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/0c971c859562455b98d919da8e1ea28b, entries=1, sequenceid=13, filesize=4.9 K 2023-11-26 15:55:40,917 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f129063d34c7e932fc424e95e294be7a in 825ms, sequenceid=13, compaction requested=true 2023-11-26 15:55:40,917 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f129063d34c7e932fc424e95e294be7a: 2023-11-26 15:55:40,917 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:40,917 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:55:40,918 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:55:40,918 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:40,918 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-26 15:55:40,918 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-26 15:55:40,919 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,919 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:40,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:40,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:40,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:40,920 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,920 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:40,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:40,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:40,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:40,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:40,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-26 15:55:40,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64607cf8[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:40,921 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-26 15:55:40,921 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,922 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,923 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-26 15:55:40,923 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-26 15:55:40,923 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:40,923 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:40,923 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:40,924 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:40,924 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-26 15:55:40,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:40,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:40,924 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:40,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:40,924 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-26 15:55:40,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:40,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:40,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:40,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:40,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:40,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:40,927 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:55:40,927 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-26 15:55:40,927 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:40,927 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:40,927 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,927 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:40,929 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,929 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:40,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:40,929 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:40,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:40,930 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:40,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:40,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:40,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:40,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,931 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:40,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:40,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:40,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:40,935 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:40,936 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:40,936 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:40,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:40,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:40,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:40,936 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,936 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:40,936 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:40,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-26 15:55:40,936 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:40,936 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:40,936 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:40,936 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:40,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:40,936 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:40,936 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,036 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:41,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:41,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:41,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:55:41,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,043 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:41,043 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:41,043 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-26 15:55:41,043 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-26 15:55:41,043 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,043 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,045 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:41,045 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:41,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:41,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:41,045 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:41,045 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:41,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:41,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,046 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,046 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-26 15:55:41,046 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,046 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-26 15:55:41,047 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:41,047 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-26 15:55:41,052 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:55:41,052 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:41,052 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:41,052 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. started... 2023-11-26 15:55:41,052 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f129063d34c7e932fc424e95e294be7a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:55:41,064 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205dc61e63d0209433097f6f34df1ba8df1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205dc61e63d0209433097f6f34df1ba8df1 2023-11-26 15:55:41,470 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/029a8e91359d436a8dbd1a2e75b70058 2023-11-26 15:55:41,479 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/029a8e91359d436a8dbd1a2e75b70058 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/029a8e91359d436a8dbd1a2e75b70058 2023-11-26 15:55:41,482 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/029a8e91359d436a8dbd1a2e75b70058, entries=1, sequenceid=17, filesize=4.9 K 2023-11-26 15:55:41,483 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f129063d34c7e932fc424e95e294be7a in 431ms, sequenceid=17, compaction requested=true 2023-11-26 15:55:41,483 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f129063d34c7e932fc424e95e294be7a: 2023-11-26 15:55:41,483 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:41,483 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:55:41,483 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:55:41,483 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:41,483 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-26 15:55:41,483 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-26 15:55:41,485 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:41,485 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:41,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:41,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:41,486 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,486 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:41,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:41,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:41,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:41,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:41,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-26 15:55:41,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7db0662[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:41,487 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-26 15:55:41,487 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,489 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,489 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-26 15:55:41,489 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-26 15:55:41,489 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:41,489 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:41,489 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:41,491 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-26 15:55:41,491 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:41,491 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:41,491 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-26 15:55:41,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:41,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:41,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:41,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:41,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:41,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:41,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:41,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:41,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:41,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:55:41,494 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-26 15:55:41,494 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:41,494 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:41,494 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,494 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:41,496 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,496 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,497 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:41,497 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:41,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:41,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:41,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:41,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:41,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,499 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:41,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:41,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:41,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:41,503 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:41,503 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:41,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:41,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-26 15:55:41,503 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:41,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:41,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:41,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:41,503 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,503 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:41,504 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:41,503 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:41,503 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:41,504 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:41,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:41,504 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,504 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,504 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,604 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:41,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:41,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:41,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:55:41,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,611 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:41,611 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:41,611 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-26 15:55:41,611 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-26 15:55:41,612 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,612 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,614 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:41,614 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:41,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:41,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:41,615 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:41,615 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:41,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:41,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,616 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,616 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-26 15:55:41,616 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:41,616 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-26 15:55:41,616 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:41,616 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-26 15:55:41,617 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:55:41,617 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:41,617 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:41,617 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. started... 2023-11-26 15:55:41,617 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f129063d34c7e932fc424e95e294be7a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:55:42,031 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512284d3d157a66874bdaa32df148b64c563c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512284d3d157a66874bdaa32df148b64c563c 2023-11-26 15:55:42,436 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/c2eaf7505ea44b7aa2d4f63c925e5728 2023-11-26 15:55:42,440 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/c2eaf7505ea44b7aa2d4f63c925e5728 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/c2eaf7505ea44b7aa2d4f63c925e5728 2023-11-26 15:55:42,443 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/c2eaf7505ea44b7aa2d4f63c925e5728, entries=1, sequenceid=21, filesize=4.9 K 2023-11-26 15:55:42,444 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f129063d34c7e932fc424e95e294be7a in 827ms, sequenceid=21, compaction requested=true 2023-11-26 15:55:42,444 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f129063d34c7e932fc424e95e294be7a: 2023-11-26 15:55:42,444 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:42,444 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:55:42,444 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:55:42,444 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,444 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-26 15:55:42,444 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-26 15:55:42,446 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,446 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:42,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:42,446 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,446 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:42,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:42,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:42,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:42,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-26 15:55:42,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8e8f675[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:42,447 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-26 15:55:42,447 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,450 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,450 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-26 15:55:42,450 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-26 15:55:42,450 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:42,450 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,450 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:42,451 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-26 15:55:42,451 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,451 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:42,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:42,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:42,451 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-26 15:55:42,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:42,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:42,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:42,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:42,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:55:42,454 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-26 15:55:42,454 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:42,454 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:42,454 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,454 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:42,455 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,455 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,455 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:42,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:42,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:42,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:42,456 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:42,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,457 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:42,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,459 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,460 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,460 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,460 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:42,460 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:42,460 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:42,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:42,460 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,460 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:42,460 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:42,460 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:42,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:42,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:42,460 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:42,460 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:42,561 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:42,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:42,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:42,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:55:42,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,567 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:42,567 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:42,567 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-26 15:55:42,567 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-26 15:55:42,568 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,568 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,575 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,575 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:42,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:42,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:42,575 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,575 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:42,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,576 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:42,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,576 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,576 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-26 15:55:42,577 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,577 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-26 15:55:42,577 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:42,577 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-26 15:55:42,582 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:55:42,582 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:42,582 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:42,582 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. started... 2023-11-26 15:55:42,582 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f129063d34c7e932fc424e95e294be7a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:55:42,596 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a4e5e30cb9254ec29de2dab646203398 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231a4e5e30cb9254ec29de2dab646203398 2023-11-26 15:55:42,601 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/62b2637864b04aaaac426f9a7de37b0e 2023-11-26 15:55:42,604 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/62b2637864b04aaaac426f9a7de37b0e as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/62b2637864b04aaaac426f9a7de37b0e 2023-11-26 15:55:42,607 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/62b2637864b04aaaac426f9a7de37b0e, entries=1, sequenceid=25, filesize=4.9 K 2023-11-26 15:55:42,608 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f129063d34c7e932fc424e95e294be7a in 26ms, sequenceid=25, compaction requested=true 2023-11-26 15:55:42,608 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f129063d34c7e932fc424e95e294be7a: 2023-11-26 15:55:42,608 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:42,608 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:55:42,608 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:55:42,608 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,608 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-26 15:55:42,608 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-26 15:55:42,610 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,610 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:42,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:42,610 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,610 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:42,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:42,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-26 15:55:42,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56e07d73[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:42,612 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-26 15:55:42,612 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,613 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,613 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-26 15:55:42,613 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-26 15:55:42,613 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:42,614 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,614 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:42,618 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:42,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:42,618 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-26 15:55:42,618 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:42,618 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-26 15:55:42,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:42,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:42,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:42,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:42,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:55:42,621 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-26 15:55:42,621 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:42,621 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:42,621 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,621 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:42,623 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,623 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:42,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:42,623 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:42,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:42,623 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:42,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:42,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:42,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,625 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:42,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,627 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,627 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,627 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:42,627 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,627 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:42,627 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:42,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:42,627 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:42,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:42,627 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,628 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:42,628 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:42,628 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,628 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:42,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:42,728 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:42,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:42,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:42,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:55:42,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,734 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:42,734 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:42,734 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-26 15:55:42,734 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-26 15:55:42,735 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,735 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,736 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:42,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:42,736 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:42,737 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:42,737 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:42,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,737 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:42,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,738 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,738 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-26 15:55:42,738 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:42,738 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-26 15:55:42,738 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:42,738 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-26 15:55:42,740 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:55:42,740 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:42,740 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:42,740 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. started... 2023-11-26 15:55:42,740 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f129063d34c7e932fc424e95e294be7a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:55:43,155 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f9b17b6aa93c4790be78ed2768611c29 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101f9b17b6aa93c4790be78ed2768611c29 2023-11-26 15:55:43,560 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/ea2800fd39734d0489a4c9ba55d19fe7 2023-11-26 15:55:43,564 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/ea2800fd39734d0489a4c9ba55d19fe7 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/ea2800fd39734d0489a4c9ba55d19fe7 2023-11-26 15:55:43,567 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/ea2800fd39734d0489a4c9ba55d19fe7, entries=1, sequenceid=29, filesize=4.9 K 2023-11-26 15:55:43,568 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f129063d34c7e932fc424e95e294be7a in 828ms, sequenceid=29, compaction requested=true 2023-11-26 15:55:43,568 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f129063d34c7e932fc424e95e294be7a: 2023-11-26 15:55:43,568 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:43,568 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:55:43,568 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:55:43,568 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:43,569 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-26 15:55:43,569 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-26 15:55:43,570 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,570 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:43,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:43,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:43,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:43,571 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,571 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:43,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:43,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:43,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:43,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:43,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-26 15:55:43,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31805ceb[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:43,572 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-26 15:55:43,572 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,574 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,574 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-26 15:55:43,574 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-26 15:55:43,574 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:43,574 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:43,574 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:43,575 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-26 15:55:43,575 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:43,575 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:43,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:43,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:43,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:43,576 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-26 15:55:43,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:43,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:43,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:43,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:43,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:43,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:43,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:55:43,578 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-26 15:55:43,578 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:43,578 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:43,578 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,578 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:43,580 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,580 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,580 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:43,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:43,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:43,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:43,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:43,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:43,581 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:43,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:43,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,582 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:43,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:43,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:43,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:43,584 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:43,584 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,584 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,584 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:43,584 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:43,584 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:43,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:43,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:43,584 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,584 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:43,584 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:43,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:43,585 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:43,585 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:43,585 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:43,586 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-26 15:55:43,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:43,685 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:43,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:43,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:43,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:55:43,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,692 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:43,692 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:43,692 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-26 15:55:43,692 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-26 15:55:43,692 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,692 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,694 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:43,694 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:43,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:43,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:43,695 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:43,695 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:43,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:43,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,696 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,696 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-26 15:55:43,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:43,696 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-26 15:55:43,696 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:43,696 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-26 15:55:43,699 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:55:43,699 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:43,699 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:43,699 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. started... 2023-11-26 15:55:43,699 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f129063d34c7e932fc424e95e294be7a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:55:44,112 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036bebf551fd0d41b29ca28b567fea77a3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601036bebf551fd0d41b29ca28b567fea77a3 2023-11-26 15:55:44,120 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-26 15:55:44,516 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/d5a971c31e1649548a08b6af02fb1dfb 2023-11-26 15:55:44,520 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/d5a971c31e1649548a08b6af02fb1dfb as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/d5a971c31e1649548a08b6af02fb1dfb 2023-11-26 15:55:44,523 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/d5a971c31e1649548a08b6af02fb1dfb, entries=1, sequenceid=33, filesize=4.9 K 2023-11-26 15:55:44,524 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f129063d34c7e932fc424e95e294be7a in 825ms, sequenceid=33, compaction requested=true 2023-11-26 15:55:44,524 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f129063d34c7e932fc424e95e294be7a: 2023-11-26 15:55:44,524 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:44,524 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:55:44,525 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:55:44,525 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:44,525 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-26 15:55:44,525 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-26 15:55:44,527 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:44,527 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:44,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:44,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:44,528 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,528 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:44,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:44,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:44,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:44,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:44,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-26 15:55:44,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6eb7a4af[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:44,529 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-26 15:55:44,529 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,530 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,531 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-26 15:55:44,531 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-26 15:55:44,531 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:44,531 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:44,531 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:44,532 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-26 15:55:44,532 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:44,532 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:44,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:44,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:44,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:44,532 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-26 15:55:44,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:44,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:44,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:44,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:44,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:55:44,534 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-26 15:55:44,535 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:44,535 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:44,535 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,535 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:44,536 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,536 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:44,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,536 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:44,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:44,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:44,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:44,537 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:44,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:44,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,538 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:44,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:44,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:44,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:44,541 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:44,541 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:44,541 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,541 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:44,541 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-26 15:55:44,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:44,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:44,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:44,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:44,541 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:44,541 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:44,541 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,541 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:44,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:44,541 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:44,541 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:44,541 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,641 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:44,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:44,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:44,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:55:44,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,647 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:44,647 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:44,647 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-26 15:55:44,647 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-26 15:55:44,648 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,648 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,649 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:44,649 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:44,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:44,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:44,649 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:44,649 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:44,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:44,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,650 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,650 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-26 15:55:44,650 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:44,650 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-26 15:55:44,651 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:44,651 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-26 15:55:44,651 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:55:44,651 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:44,651 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:44,651 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. started... 2023-11-26 15:55:44,651 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f129063d34c7e932fc424e95e294be7a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:55:45,065 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907137d4dbb03fc4eaa86041d544ec466d4 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907137d4dbb03fc4eaa86041d544ec466d4 2023-11-26 15:55:45,483 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/bc3b49ba38184ebea09830adc9827d11 2023-11-26 15:55:45,487 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/bc3b49ba38184ebea09830adc9827d11 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/bc3b49ba38184ebea09830adc9827d11 2023-11-26 15:55:45,491 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/bc3b49ba38184ebea09830adc9827d11, entries=1, sequenceid=37, filesize=4.9 K 2023-11-26 15:55:45,491 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f129063d34c7e932fc424e95e294be7a in 840ms, sequenceid=37, compaction requested=true 2023-11-26 15:55:45,491 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f129063d34c7e932fc424e95e294be7a: 2023-11-26 15:55:45,492 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:45,492 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:55:45,492 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:55:45,492 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:45,492 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-26 15:55:45,492 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-26 15:55:45,496 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:45,496 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:45,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:45,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:45,497 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,497 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:45,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:45,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-26 15:55:45,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21a3bc52[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:45,498 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-26 15:55:45,498 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,499 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,499 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-26 15:55:45,499 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-26 15:55:45,499 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:45,499 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:45,499 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:45,501 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:45,501 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-26 15:55:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:45,501 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:45,501 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-26 15:55:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:45,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:45,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:45,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:45,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:45,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:45,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:55:45,503 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-26 15:55:45,503 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:45,503 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:45,503 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,503 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:45,505 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,505 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:45,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:45,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,505 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:45,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:45,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:45,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:45,505 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:45,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:45,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:45,507 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:45,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:45,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:45,510 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:45,510 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:45,510 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,510 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:45,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:45,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:45,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:45,510 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:45,510 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:45,511 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:45,511 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:45,511 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:45,511 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,511 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,511 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:45,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:45,611 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:45,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:45,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:45,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-26 15:55:45,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,617 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:45,617 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:45,618 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-26 15:55:45,618 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-26 15:55:45,618 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,618 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,619 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:45,619 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:45,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:45,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:45,620 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:45,620 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:45,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,620 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:45,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,621 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,621 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-26 15:55:45,621 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:45,621 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-26 15:55:45,621 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:45,621 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-26 15:55:45,621 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-26 15:55:45,621 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:45,621 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:45,621 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. started... 2023-11-26 15:55:45,621 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f129063d34c7e932fc424e95e294be7a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-26 15:55:46,032 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120d67c89631e084c13a1af37661603df82 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120d67c89631e084c13a1af37661603df82 2023-11-26 15:55:46,039 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/15a0a3fdbf5c4787b1c3c02a5500dd02 2023-11-26 15:55:46,043 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/15a0a3fdbf5c4787b1c3c02a5500dd02 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/15a0a3fdbf5c4787b1c3c02a5500dd02 2023-11-26 15:55:46,046 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/15a0a3fdbf5c4787b1c3c02a5500dd02, entries=1, sequenceid=41, filesize=4.9 K 2023-11-26 15:55:46,047 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f129063d34c7e932fc424e95e294be7a in 426ms, sequenceid=41, compaction requested=true 2023-11-26 15:55:46,047 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f129063d34c7e932fc424e95e294be7a: 2023-11-26 15:55:46,047 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:46,047 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-26 15:55:46,047 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-26 15:55:46,047 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:46,047 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-26 15:55:46,047 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-26 15:55:46,049 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:46,049 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:46,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:46,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:46,049 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,049 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:46,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:46,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:46,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:46,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:46,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-26 15:55:46,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@747d46f0[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:46,051 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-26 15:55:46,051 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,052 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,052 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-26 15:55:46,052 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-26 15:55:46,052 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:46,052 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:46,052 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:46,054 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:46,054 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-26 15:55:46,054 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:46,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:46,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:46,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:46,054 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-26 15:55:46,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:46,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:46,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:46,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:46,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:46,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:46,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-26 15:55:46,058 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-26 15:55:46,058 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:46,058 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:46,058 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,058 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:46,059 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,059 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:46,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:46,059 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:46,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,060 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:46,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:46,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:46,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:46,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:46,061 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:46,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:46,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:46,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,064 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:46,064 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,064 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:46,064 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:46,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-26 15:55:46,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:46,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:46,064 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:46,064 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:46,064 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:46,064 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:46,065 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,064 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:46,064 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-26 15:55:46,065 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:46,065 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:46,165 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:46,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:46,167 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33415] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-11-26 15:55:46,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-26 15:55:46,169 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-26 15:55:46,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:55:46,170 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701014746170 2023-11-26 15:55:46,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-26 15:55:46,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-26 15:55:46,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-26 15:55:46,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] zookeeper.ReadOnlyZKClient(139): Connect 0x5c909229 to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:55:46,176 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e863a6e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:55:46,176 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-26 15:55:47,000 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030f04db6270524e42a9898fc4bd7c91a5 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601030f04db6270524e42a9898fc4bd7c91a5 2023-11-26 15:55:47,001 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-26 15:55:47,014 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:55:47,016 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48096, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:55:47,022 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-26 15:55:47,023 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51360, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-26 15:55:47,031 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/5487d710d352470f99f2a7da63936a59 first=Optional[r5] last=Optional[r6] 2023-11-26 15:55:47,031 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/5487d710d352470f99f2a7da63936a59}] 2023-11-26 15:55:47,038 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/5487d710d352470f99f2a7da63936a59 for inclusion in f129063d34c7e932fc424e95e294be7a/family1 2023-11-26 15:55:47,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-26 15:55:47,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last= 2023-11-26 15:55:47,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for f129063d34c7e932fc424e95e294be7a: 2023-11-26 15:55:47,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/5487d710d352470f99f2a7da63936a59 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__s693n1hkemkfe6t5p3uov1op7k269cbvgjg8ql2s7f84dq7i1a26gq8afclj6mtq/family1/5487d710d352470f99f2a7da63936a59 2023-11-26 15:55:47,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__s693n1hkemkfe6t5p3uov1op7k269cbvgjg8ql2s7f84dq7i1a26gq8afclj6mtq/family1/5487d710d352470f99f2a7da63936a59 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/38ced290e06c4473b2c0502bb05e3d23_SeqId_44_ 2023-11-26 15:55:47,043 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__s693n1hkemkfe6t5p3uov1op7k269cbvgjg8ql2s7f84dq7i1a26gq8afclj6mtq/family1/5487d710d352470f99f2a7da63936a59 into f129063d34c7e932fc424e95e294be7a/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/38ced290e06c4473b2c0502bb05e3d23_SeqId_44_ - updating store file list. 2023-11-26 15:55:47,046 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/38ced290e06c4473b2c0502bb05e3d23_SeqId_44_ into f129063d34c7e932fc424e95e294be7a/family1 2023-11-26 15:55:47,046 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__s693n1hkemkfe6t5p3uov1op7k269cbvgjg8ql2s7f84dq7i1a26gq8afclj6mtq/family1/5487d710d352470f99f2a7da63936a59 into f129063d34c7e932fc424e95e294be7a/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/38ced290e06c4473b2c0502bb05e3d23_SeqId_44_) 2023-11-26 15:55:47,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__s693n1hkemkfe6t5p3uov1op7k269cbvgjg8ql2s7f84dq7i1a26gq8afclj6mtq/family1/5487d710d352470f99f2a7da63936a59 2023-11-26 15:55:47,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-26 15:55:47,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-26 15:55:47,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(1912): f129063d34c7e932fc424e95e294be7a/family1 is initiating minor compaction 2023-11-26 15:55:47,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@64034169; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:55:47,049 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f129063d34c7e932fc424e95e294be7a/family1 in testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:47,049 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/63e87e61c57a4c3f87d081e92e50f3d3, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/0c971c859562455b98d919da8e1ea28b, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/029a8e91359d436a8dbd1a2e75b70058, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/c2eaf7505ea44b7aa2d4f63c925e5728, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/62b2637864b04aaaac426f9a7de37b0e, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/ea2800fd39734d0489a4c9ba55d19fe7, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/d5a971c31e1649548a08b6af02fb1dfb, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/bc3b49ba38184ebea09830adc9827d11, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/15a0a3fdbf5c4787b1c3c02a5500dd02, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/38ced290e06c4473b2c0502bb05e3d23_SeqId_44_] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp, totalSize=49.7 K 2023-11-26 15:55:47,049 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 63e87e61c57a4c3f87d081e92e50f3d3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-26 15:55:47,050 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 0c971c859562455b98d919da8e1ea28b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-26 15:55:47,050 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 029a8e91359d436a8dbd1a2e75b70058, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-26 15:55:47,050 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting c2eaf7505ea44b7aa2d4f63c925e5728, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-26 15:55:47,050 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 62b2637864b04aaaac426f9a7de37b0e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-26 15:55:47,050 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting ea2800fd39734d0489a4c9ba55d19fe7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-26 15:55:47,050 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting d5a971c31e1649548a08b6af02fb1dfb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-26 15:55:47,050 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting bc3b49ba38184ebea09830adc9827d11, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-26 15:55:47,050 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 15a0a3fdbf5c4787b1c3c02a5500dd02, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-26 15:55:47,050 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 38ced290e06c4473b2c0502bb05e3d23_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-26 15:55:47,051 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-26 15:55:47,052 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:47,053 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101f9b17b6aa93c4790be78ed2768611c29 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101f9b17b6aa93c4790be78ed2768611c29 2023-11-26 15:55:47,054 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601036bebf551fd0d41b29ca28b567fea77a3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601036bebf551fd0d41b29ca28b567fea77a3 2023-11-26 15:55:47,054 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-26 15:55:47,054 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-26 15:55:47,055 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-26 15:55:47,055 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-26 15:55:47,082 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] throttle.PressureAwareThroughputController(145): f129063d34c7e932fc424e95e294be7a#family1#compaction#166 average throughput is 0.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:47,096 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/59c0d319cb0a4134afde36702781a77c as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/59c0d319cb0a4134afde36702781a77c 2023-11-26 15:55:47,099 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f129063d34c7e932fc424e95e294be7a/family1 of f129063d34c7e932fc424e95e294be7a into 59c0d319cb0a4134afde36702781a77c(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:55:47,100 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f129063d34c7e932fc424e95e294be7a: 2023-11-26 15:55:47,100 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1701014147049; duration=0sec 2023-11-26 15:55:47,100 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:55:47,147 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/63e87e61c57a4c3f87d081e92e50f3d3, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/0c971c859562455b98d919da8e1ea28b, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/029a8e91359d436a8dbd1a2e75b70058, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/c2eaf7505ea44b7aa2d4f63c925e5728, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/62b2637864b04aaaac426f9a7de37b0e, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/ea2800fd39734d0489a4c9ba55d19fe7, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/d5a971c31e1649548a08b6af02fb1dfb, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/bc3b49ba38184ebea09830adc9827d11, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/15a0a3fdbf5c4787b1c3c02a5500dd02, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/38ced290e06c4473b2c0502bb05e3d23_SeqId_44_] to archive 2023-11-26 15:55:47,148 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:47,150 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/63e87e61c57a4c3f87d081e92e50f3d3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/63e87e61c57a4c3f87d081e92e50f3d3 2023-11-26 15:55:47,152 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/0c971c859562455b98d919da8e1ea28b to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/0c971c859562455b98d919da8e1ea28b 2023-11-26 15:55:47,153 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/029a8e91359d436a8dbd1a2e75b70058 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/029a8e91359d436a8dbd1a2e75b70058 2023-11-26 15:55:47,154 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/c2eaf7505ea44b7aa2d4f63c925e5728 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/c2eaf7505ea44b7aa2d4f63c925e5728 2023-11-26 15:55:47,155 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/62b2637864b04aaaac426f9a7de37b0e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/62b2637864b04aaaac426f9a7de37b0e 2023-11-26 15:55:47,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/ea2800fd39734d0489a4c9ba55d19fe7 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/ea2800fd39734d0489a4c9ba55d19fe7 2023-11-26 15:55:47,157 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/d5a971c31e1649548a08b6af02fb1dfb to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/d5a971c31e1649548a08b6af02fb1dfb 2023-11-26 15:55:47,158 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/bc3b49ba38184ebea09830adc9827d11 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/bc3b49ba38184ebea09830adc9827d11 2023-11-26 15:55:47,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/15a0a3fdbf5c4787b1c3c02a5500dd02 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/15a0a3fdbf5c4787b1c3c02a5500dd02 2023-11-26 15:55:47,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/38ced290e06c4473b2c0502bb05e3d23_SeqId_44_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/38ced290e06c4473b2c0502bb05e3d23_SeqId_44_ 2023-11-26 15:55:47,498 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512313c8e493c55494dd7820a5a1b98ed5cce to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512313c8e493c55494dd7820a5a1b98ed5cce 2023-11-26 15:55:47,499 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-26 15:55:47,529 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f59d82edd17a48479b54a46370428226 first=Optional[r1] last=Optional[r4] 2023-11-26 15:55:47,530 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f59d82edd17a48479b54a46370428226}] 2023-11-26 15:55:47,532 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f59d82edd17a48479b54a46370428226 for inclusion in f129063d34c7e932fc424e95e294be7a/family1 2023-11-26 15:55:47,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-26 15:55:47,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last= 2023-11-26 15:55:47,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for f129063d34c7e932fc424e95e294be7a: 2023-11-26 15:55:47,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f59d82edd17a48479b54a46370428226 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7qfruh73vjq1ellbk7okngcadi7toaffe51q9osr7dessrf29qhre5esqf3bimc6/family1/f59d82edd17a48479b54a46370428226 2023-11-26 15:55:47,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7qfruh73vjq1ellbk7okngcadi7toaffe51q9osr7dessrf29qhre5esqf3bimc6/family1/f59d82edd17a48479b54a46370428226 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/9714ba3cc285482890c6a0f85b0c8fc5_SeqId_47_ 2023-11-26 15:55:47,538 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7qfruh73vjq1ellbk7okngcadi7toaffe51q9osr7dessrf29qhre5esqf3bimc6/family1/f59d82edd17a48479b54a46370428226 into f129063d34c7e932fc424e95e294be7a/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/9714ba3cc285482890c6a0f85b0c8fc5_SeqId_47_ - updating store file list. 2023-11-26 15:55:47,542 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/9714ba3cc285482890c6a0f85b0c8fc5_SeqId_47_ into f129063d34c7e932fc424e95e294be7a/family1 2023-11-26 15:55:47,542 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7qfruh73vjq1ellbk7okngcadi7toaffe51q9osr7dessrf29qhre5esqf3bimc6/family1/f59d82edd17a48479b54a46370428226 into f129063d34c7e932fc424e95e294be7a/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/9714ba3cc285482890c6a0f85b0c8fc5_SeqId_47_) 2023-11-26 15:55:47,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7qfruh73vjq1ellbk7okngcadi7toaffe51q9osr7dessrf29qhre5esqf3bimc6/family1/f59d82edd17a48479b54a46370428226 2023-11-26 15:55:47,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-26 15:55:47,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-26 15:55:47,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(1912): f129063d34c7e932fc424e95e294be7a/family1 is initiating minor compaction (all files) 2023-11-26 15:55:47,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5ea1962a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:55:47,550 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f129063d34c7e932fc424e95e294be7a/family1 in testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:55:47,550 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/c89118ff3eb94597b77436daa2f26cc1, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/59c0d319cb0a4134afde36702781a77c, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/9714ba3cc285482890c6a0f85b0c8fc5_SeqId_47_] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp, totalSize=178.1 K 2023-11-26 15:55:47,550 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting c89118ff3eb94597b77436daa2f26cc1, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878823935 2023-11-26 15:55:47,551 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 59c0d319cb0a4134afde36702781a77c, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621223935 2023-11-26 15:55:47,551 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] compactions.Compactor(207): Compacting 9714ba3cc285482890c6a0f85b0c8fc5_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965223935 2023-11-26 15:55:47,552 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-26 15:55:47,552 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:47,555 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201fa69d4ea95264167be3856844056b2d0 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201fa69d4ea95264167be3856844056b2d0 2023-11-26 15:55:47,557 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205dc61e63d0209433097f6f34df1ba8df1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205dc61e63d0209433097f6f34df1ba8df1 2023-11-26 15:55:47,558 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512284d3d157a66874bdaa32df148b64c563c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512284d3d157a66874bdaa32df148b64c563c 2023-11-26 15:55:47,560 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231a4e5e30cb9254ec29de2dab646203398 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231a4e5e30cb9254ec29de2dab646203398 2023-11-26 15:55:47,560 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-26 15:55:47,560 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-26 15:55:47,560 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-26 15:55:47,560 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-26 15:55:47,566 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] throttle.PressureAwareThroughputController(145): f129063d34c7e932fc424e95e294be7a#family1#compaction#167 average throughput is 22.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:47,998 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/.tmp/family1/896c13126eb2437da6e95c8752974e80 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/896c13126eb2437da6e95c8752974e80 2023-11-26 15:55:48,001 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in f129063d34c7e932fc424e95e294be7a/family1 of f129063d34c7e932fc424e95e294be7a into 896c13126eb2437da6e95c8752974e80(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:55:48,001 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f129063d34c7e932fc424e95e294be7a: 2023-11-26 15:55:48,001 INFO [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1701014147549; duration=0sec 2023-11-26 15:55:48,001 DEBUG [RS:0;jenkins-hbase4:41861-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-26 15:55:48,051 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/c89118ff3eb94597b77436daa2f26cc1, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/59c0d319cb0a4134afde36702781a77c, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/9714ba3cc285482890c6a0f85b0c8fc5_SeqId_47_] to archive 2023-11-26 15:55:48,051 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:48,053 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/c89118ff3eb94597b77436daa2f26cc1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/c89118ff3eb94597b77436daa2f26cc1 2023-11-26 15:55:48,054 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/59c0d319cb0a4134afde36702781a77c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/59c0d319cb0a4134afde36702781a77c 2023-11-26 15:55:48,055 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/9714ba3cc285482890c6a0f85b0c8fc5_SeqId_47_ to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/9714ba3cc285482890c6a0f85b0c8fc5_SeqId_47_ 2023-11-26 15:55:48,408 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130d545999e0ce74dcb8d5213ccaa393399 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130d545999e0ce74dcb8d5213ccaa393399 2023-11-26 15:55:48,409 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-26 15:55:48,432 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/87542965c1784b37a2b0c3bac2473709 first=Optional[r00] last=Optional[r8] 2023-11-26 15:55:48,432 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/87542965c1784b37a2b0c3bac2473709}] 2023-11-26 15:55:48,434 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/87542965c1784b37a2b0c3bac2473709 for inclusion in f129063d34c7e932fc424e95e294be7a/family1 2023-11-26 15:55:48,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-26 15:55:48,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last= 2023-11-26 15:55:48,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for f129063d34c7e932fc424e95e294be7a: 2023-11-26 15:55:48,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/87542965c1784b37a2b0c3bac2473709 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__lq88t1i4oo7lo0rk5bij23gvd3hb97o5v17sct22ecc19cqm5sh11h1ibicnph1d/family1/87542965c1784b37a2b0c3bac2473709 2023-11-26 15:55:48,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__lq88t1i4oo7lo0rk5bij23gvd3hb97o5v17sct22ecc19cqm5sh11h1ibicnph1d/family1/87542965c1784b37a2b0c3bac2473709 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/77bef1185bd84a158256c125c0262df7_SeqId_50_ 2023-11-26 15:55:48,439 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__lq88t1i4oo7lo0rk5bij23gvd3hb97o5v17sct22ecc19cqm5sh11h1ibicnph1d/family1/87542965c1784b37a2b0c3bac2473709 into f129063d34c7e932fc424e95e294be7a/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/77bef1185bd84a158256c125c0262df7_SeqId_50_ - updating store file list. 2023-11-26 15:55:48,441 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/77bef1185bd84a158256c125c0262df7_SeqId_50_ into f129063d34c7e932fc424e95e294be7a/family1 2023-11-26 15:55:48,441 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__lq88t1i4oo7lo0rk5bij23gvd3hb97o5v17sct22ecc19cqm5sh11h1ibicnph1d/family1/87542965c1784b37a2b0c3bac2473709 into f129063d34c7e932fc424e95e294be7a/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/family1/77bef1185bd84a158256c125c0262df7_SeqId_50_) 2023-11-26 15:55:48,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMinorCompactionWithMonthlyPolicy__lq88t1i4oo7lo0rk5bij23gvd3hb97o5v17sct22ecc19cqm5sh11h1ibicnph1d/family1/87542965c1784b37a2b0c3bac2473709 2023-11-26 15:55:48,443 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-26 15:55:48,444 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:48,445 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120d67c89631e084c13a1af37661603df82 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120d67c89631e084c13a1af37661603df82 2023-11-26 15:55:48,446 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112882988963cea947c681ef31c7f8dd62b4 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112882988963cea947c681ef31c7f8dd62b4 2023-11-26 15:55:48,447 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130b42b4f2aea814d37a3498b5d8a0dad8d to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130b42b4f2aea814d37a3498b5d8a0dad8d 2023-11-26 15:55:48,447 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-26 15:55:48,447 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-26 15:55:48,447 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-26 15:55:48,447 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-26 15:55:48,447 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-26 15:55:48,447 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-26 15:55:48,447 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:55:48,449 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-26 15:55:48,450 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.2810 sec 2023-11-26 15:55:48,667 INFO [Listener at localhost/43645] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=260 (was 251) - Thread LEAK? -, OpenFileDescriptor=675 (was 661) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=214 (was 200) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=8214 (was 8121) - AvailableMemoryMB LEAK? - 2023-11-26 15:55:48,680 INFO [Listener at localhost/43645] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=260, OpenFileDescriptor=675, MaxFileDescriptor=60000, SystemLoadAverage=214, ProcessCount=168, AvailableMemoryMB=8213 2023-11-26 15:55:48,707 DEBUG [Listener at localhost/43645] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-11-26 15:55:48,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC9\x18X\xF63\xB2^\x94\xA7\x94\xB0\xD2@\x1F\xD5\xC5"\x10t\xFD-\xA7\xA2^\xC83\xD5A\x9AAQ\x8D\x1Cg*\x10J/M\x99`\x94vo\x1D\x99D3\xBB\x05O\xD32\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-26 15:55:48,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-11-26 15:55:48,768 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-11-26 15:55:48,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-11-26 15:55:48,768 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-26 15:55:48,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-26 15:55:48,770 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa 2023-11-26 15:55:48,770 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea 2023-11-26 15:55:48,772 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa empty. 2023-11-26 15:55:48,772 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23 2023-11-26 15:55:48,772 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea empty. 2023-11-26 15:55:48,772 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa 2023-11-26 15:55:48,773 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23 empty. 2023-11-26 15:55:48,773 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea 2023-11-26 15:55:48,773 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23 2023-11-26 15:55:48,774 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-11-26 15:55:48,780 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-11-26 15:55:48,789 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => e7ba85103d9b5b3dd1d2b42cea0bd1fa, NAME => 'testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC9\x18X\xF63\xB2^\x94\xA7\x94\xB0\xD2@\x1F\xD5\xC5"\x10t\xFD-\xA7\xA2^\xC83\xD5A\x9AAQ\x8D\x1Cg*\x10J/M\x99`\x94vo\x1D\x99D3\xBB\x05O\xD32\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:55:48,789 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 2b5c98810f62b16839301eb6de0d4e23, NAME => 'testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC9\x18X\xF63\xB2^\x94\xA7\x94\xB0\xD2@\x1F\xD5\xC5"\x10t\xFD-\xA7\xA2^\xC83\xD5A\x9AAQ\x8D\x1Cg*\x10J/M\x99`\x94vo\x1D\x99D3\xBB\x05O\xD32\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:55:48,789 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 905d5b9a6c25e80983010d7024fe6dea, NAME => 'testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC9\x18X\xF63\xB2^\x94\xA7\x94\xB0\xD2@\x1F\xD5\xC5"\x10t\xFD-\xA7\xA2^\xC83\xD5A\x9AAQ\x8D\x1Cg*\x10J/M\x99`\x94vo\x1D\x99D3\xBB\x05O\xD32\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/.tmp 2023-11-26 15:55:48,801 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:55:48,801 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing e7ba85103d9b5b3dd1d2b42cea0bd1fa, disabling compactions & flushes 2023-11-26 15:55:48,801 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:55:48,801 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:55:48,801 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. after waiting 0 ms 2023-11-26 15:55:48,801 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:55:48,801 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:55:48,801 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for e7ba85103d9b5b3dd1d2b42cea0bd1fa: 2023-11-26 15:55:48,802 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:55:48,802 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 905d5b9a6c25e80983010d7024fe6dea, disabling compactions & flushes 2023-11-26 15:55:48,802 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:55:48,802 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:55:48,802 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. after waiting 0 ms 2023-11-26 15:55:48,802 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:55:48,802 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:55:48,802 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 905d5b9a6c25e80983010d7024fe6dea: 2023-11-26 15:55:48,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-26 15:55:49,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-26 15:55:49,196 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:55:49,197 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 2b5c98810f62b16839301eb6de0d4e23, disabling compactions & flushes 2023-11-26 15:55:49,197 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:55:49,197 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:55:49,197 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. after waiting 0 ms 2023-11-26 15:55:49,197 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:55:49,197 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:55:49,197 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 2b5c98810f62b16839301eb6de0d4e23: 2023-11-26 15:55:49,199 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-11-26 15:55:49,200 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701014149199"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014149199"}]},"ts":"1701014149199"} 2023-11-26 15:55:49,200 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1701014149199"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014149199"}]},"ts":"1701014149199"} 2023-11-26 15:55:49,200 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701014149199"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701014149199"}]},"ts":"1701014149199"} 2023-11-26 15:55:49,201 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-26 15:55:49,202 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-26 15:55:49,202 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014149202"}]},"ts":"1701014149202"} 2023-11-26 15:55:49,203 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-11-26 15:55:49,206 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e7ba85103d9b5b3dd1d2b42cea0bd1fa, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=905d5b9a6c25e80983010d7024fe6dea, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=2b5c98810f62b16839301eb6de0d4e23, ASSIGN}] 2023-11-26 15:55:49,207 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=905d5b9a6c25e80983010d7024fe6dea, ASSIGN 2023-11-26 15:55:49,207 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e7ba85103d9b5b3dd1d2b42cea0bd1fa, ASSIGN 2023-11-26 15:55:49,207 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=2b5c98810f62b16839301eb6de0d4e23, ASSIGN 2023-11-26 15:55:49,208 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=905d5b9a6c25e80983010d7024fe6dea, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:55:49,208 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e7ba85103d9b5b3dd1d2b42cea0bd1fa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:55:49,208 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=2b5c98810f62b16839301eb6de0d4e23, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41861,1701014000937; forceNewPlan=false, retain=false 2023-11-26 15:55:49,360 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=2b5c98810f62b16839301eb6de0d4e23, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:49,360 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=e7ba85103d9b5b3dd1d2b42cea0bd1fa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:49,360 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701014149360"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014149360"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014149360"}]},"ts":"1701014149360"} 2023-11-26 15:55:49,360 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=905d5b9a6c25e80983010d7024fe6dea, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:49,360 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701014149360"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014149360"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014149360"}]},"ts":"1701014149360"} 2023-11-26 15:55:49,360 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1701014149360"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701014149360"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701014149360"}]},"ts":"1701014149360"} 2023-11-26 15:55:49,362 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE; OpenRegionProcedure 2b5c98810f62b16839301eb6de0d4e23, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:55:49,364 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=117, state=RUNNABLE; OpenRegionProcedure e7ba85103d9b5b3dd1d2b42cea0bd1fa, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:55:49,369 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure 905d5b9a6c25e80983010d7024fe6dea, server=jenkins-hbase4.apache.org,41861,1701014000937}] 2023-11-26 15:55:49,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-26 15:55:49,520 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:49,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:55:49,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e7ba85103d9b5b3dd1d2b42cea0bd1fa, NAME => 'testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa.', STARTKEY => '', ENDKEY => '1'} 2023-11-26 15:55:49,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin e7ba85103d9b5b3dd1d2b42cea0bd1fa 2023-11-26 15:55:49,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:55:49,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e7ba85103d9b5b3dd1d2b42cea0bd1fa 2023-11-26 15:55:49,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e7ba85103d9b5b3dd1d2b42cea0bd1fa 2023-11-26 15:55:49,546 INFO [StoreOpener-e7ba85103d9b5b3dd1d2b42cea0bd1fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e7ba85103d9b5b3dd1d2b42cea0bd1fa 2023-11-26 15:55:49,547 DEBUG [StoreOpener-e7ba85103d9b5b3dd1d2b42cea0bd1fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1 2023-11-26 15:55:49,547 DEBUG [StoreOpener-e7ba85103d9b5b3dd1d2b42cea0bd1fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1 2023-11-26 15:55:49,548 INFO [StoreOpener-e7ba85103d9b5b3dd1d2b42cea0bd1fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7ba85103d9b5b3dd1d2b42cea0bd1fa columnFamilyName family1 2023-11-26 15:55:49,549 INFO [StoreOpener-e7ba85103d9b5b3dd1d2b42cea0bd1fa-1] regionserver.HStore(310): Store=e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:55:49,549 INFO [StoreOpener-e7ba85103d9b5b3dd1d2b42cea0bd1fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e7ba85103d9b5b3dd1d2b42cea0bd1fa 2023-11-26 15:55:49,550 DEBUG [StoreOpener-e7ba85103d9b5b3dd1d2b42cea0bd1fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2 2023-11-26 15:55:49,550 DEBUG [StoreOpener-e7ba85103d9b5b3dd1d2b42cea0bd1fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2 2023-11-26 15:55:49,550 INFO [StoreOpener-e7ba85103d9b5b3dd1d2b42cea0bd1fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7ba85103d9b5b3dd1d2b42cea0bd1fa columnFamilyName family2 2023-11-26 15:55:49,551 INFO [StoreOpener-e7ba85103d9b5b3dd1d2b42cea0bd1fa-1] regionserver.HStore(310): Store=e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:55:49,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa 2023-11-26 15:55:49,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa 2023-11-26 15:55:49,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-26 15:55:49,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e7ba85103d9b5b3dd1d2b42cea0bd1fa 2023-11-26 15:55:49,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:55:49,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e7ba85103d9b5b3dd1d2b42cea0bd1fa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69451897, jitterRate=0.034913912415504456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-26 15:55:49,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e7ba85103d9b5b3dd1d2b42cea0bd1fa: 2023-11-26 15:55:49,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa., pid=121, masterSystemTime=1701014149520 2023-11-26 15:55:49,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:55:49,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:55:49,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:55:49,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2b5c98810f62b16839301eb6de0d4e23, NAME => 'testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23.', STARTKEY => '2', ENDKEY => ''} 2023-11-26 15:55:49,560 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=e7ba85103d9b5b3dd1d2b42cea0bd1fa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:49,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 2b5c98810f62b16839301eb6de0d4e23 2023-11-26 15:55:49,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:55:49,560 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701014149560"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014149560"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014149560"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014149560"}]},"ts":"1701014149560"} 2023-11-26 15:55:49,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2b5c98810f62b16839301eb6de0d4e23 2023-11-26 15:55:49,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2b5c98810f62b16839301eb6de0d4e23 2023-11-26 15:55:49,563 INFO [PEWorker-4] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=121, resume processing ppid=117 2023-11-26 15:55:49,563 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=117, state=SUCCESS; OpenRegionProcedure e7ba85103d9b5b3dd1d2b42cea0bd1fa, server=jenkins-hbase4.apache.org,41861,1701014000937 in 198 msec 2023-11-26 15:55:49,564 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=e7ba85103d9b5b3dd1d2b42cea0bd1fa, ASSIGN in 357 msec 2023-11-26 15:55:49,583 INFO [StoreOpener-2b5c98810f62b16839301eb6de0d4e23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2b5c98810f62b16839301eb6de0d4e23 2023-11-26 15:55:49,584 DEBUG [StoreOpener-2b5c98810f62b16839301eb6de0d4e23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1 2023-11-26 15:55:49,584 DEBUG [StoreOpener-2b5c98810f62b16839301eb6de0d4e23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1 2023-11-26 15:55:49,585 INFO [StoreOpener-2b5c98810f62b16839301eb6de0d4e23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b5c98810f62b16839301eb6de0d4e23 columnFamilyName family1 2023-11-26 15:55:49,585 INFO [StoreOpener-2b5c98810f62b16839301eb6de0d4e23-1] regionserver.HStore(310): Store=2b5c98810f62b16839301eb6de0d4e23/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:55:49,586 INFO [StoreOpener-2b5c98810f62b16839301eb6de0d4e23-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2b5c98810f62b16839301eb6de0d4e23 2023-11-26 15:55:49,587 DEBUG [StoreOpener-2b5c98810f62b16839301eb6de0d4e23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2 2023-11-26 15:55:49,587 DEBUG [StoreOpener-2b5c98810f62b16839301eb6de0d4e23-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2 2023-11-26 15:55:49,587 INFO [StoreOpener-2b5c98810f62b16839301eb6de0d4e23-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b5c98810f62b16839301eb6de0d4e23 columnFamilyName family2 2023-11-26 15:55:49,588 INFO [StoreOpener-2b5c98810f62b16839301eb6de0d4e23-1] regionserver.HStore(310): Store=2b5c98810f62b16839301eb6de0d4e23/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:55:49,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23 2023-11-26 15:55:49,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23 2023-11-26 15:55:49,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-26 15:55:49,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2b5c98810f62b16839301eb6de0d4e23 2023-11-26 15:55:49,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:55:49,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2b5c98810f62b16839301eb6de0d4e23; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61277054, jitterRate=-0.0869007408618927}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-26 15:55:49,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2b5c98810f62b16839301eb6de0d4e23: 2023-11-26 15:55:49,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23., pid=120, masterSystemTime=1701014149520 2023-11-26 15:55:49,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:55:49,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:55:49,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:55:49,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 905d5b9a6c25e80983010d7024fe6dea, NAME => 'testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea.', STARTKEY => '1', ENDKEY => '2'} 2023-11-26 15:55:49,596 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=2b5c98810f62b16839301eb6de0d4e23, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:49,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 905d5b9a6c25e80983010d7024fe6dea 2023-11-26 15:55:49,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-26 15:55:49,596 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701014149596"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014149596"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014149596"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014149596"}]},"ts":"1701014149596"} 2023-11-26 15:55:49,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 905d5b9a6c25e80983010d7024fe6dea 2023-11-26 15:55:49,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 905d5b9a6c25e80983010d7024fe6dea 2023-11-26 15:55:49,599 INFO [PEWorker-2] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=120, resume processing ppid=119 2023-11-26 15:55:49,599 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=119, state=SUCCESS; OpenRegionProcedure 2b5c98810f62b16839301eb6de0d4e23, server=jenkins-hbase4.apache.org,41861,1701014000937 in 236 msec 2023-11-26 15:55:49,600 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=2b5c98810f62b16839301eb6de0d4e23, ASSIGN in 393 msec 2023-11-26 15:55:49,617 INFO [StoreOpener-905d5b9a6c25e80983010d7024fe6dea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 905d5b9a6c25e80983010d7024fe6dea 2023-11-26 15:55:49,619 DEBUG [StoreOpener-905d5b9a6c25e80983010d7024fe6dea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1 2023-11-26 15:55:49,619 DEBUG [StoreOpener-905d5b9a6c25e80983010d7024fe6dea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1 2023-11-26 15:55:49,619 INFO [StoreOpener-905d5b9a6c25e80983010d7024fe6dea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 905d5b9a6c25e80983010d7024fe6dea columnFamilyName family1 2023-11-26 15:55:49,620 INFO [StoreOpener-905d5b9a6c25e80983010d7024fe6dea-1] regionserver.HStore(310): Store=905d5b9a6c25e80983010d7024fe6dea/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:55:49,620 INFO [StoreOpener-905d5b9a6c25e80983010d7024fe6dea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 905d5b9a6c25e80983010d7024fe6dea 2023-11-26 15:55:49,621 DEBUG [StoreOpener-905d5b9a6c25e80983010d7024fe6dea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2 2023-11-26 15:55:49,621 DEBUG [StoreOpener-905d5b9a6c25e80983010d7024fe6dea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2 2023-11-26 15:55:49,621 INFO [StoreOpener-905d5b9a6c25e80983010d7024fe6dea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 905d5b9a6c25e80983010d7024fe6dea columnFamilyName family2 2023-11-26 15:55:49,622 INFO [StoreOpener-905d5b9a6c25e80983010d7024fe6dea-1] regionserver.HStore(310): Store=905d5b9a6c25e80983010d7024fe6dea/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-26 15:55:49,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea 2023-11-26 15:55:49,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea 2023-11-26 15:55:49,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-26 15:55:49,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 905d5b9a6c25e80983010d7024fe6dea 2023-11-26 15:55:49,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-26 15:55:49,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 905d5b9a6c25e80983010d7024fe6dea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65217580, jitterRate=-0.02818232774734497}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-26 15:55:49,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 905d5b9a6c25e80983010d7024fe6dea: 2023-11-26 15:55:49,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea., pid=122, masterSystemTime=1701014149520 2023-11-26 15:55:49,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:55:49,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:55:49,630 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=905d5b9a6c25e80983010d7024fe6dea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:49,630 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1701014149630"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701014149630"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701014149630"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701014149630"}]},"ts":"1701014149630"} 2023-11-26 15:55:49,632 INFO [PEWorker-3] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=122, resume processing ppid=118 2023-11-26 15:55:49,632 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure 905d5b9a6c25e80983010d7024fe6dea, server=jenkins-hbase4.apache.org,41861,1701014000937 in 266 msec 2023-11-26 15:55:49,633 INFO [PEWorker-5] procedure2.ProcedureExecutor(1825): Finished subprocedure pid=118, resume processing ppid=116 2023-11-26 15:55:49,633 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=905d5b9a6c25e80983010d7024fe6dea, ASSIGN in 426 msec 2023-11-26 15:55:49,633 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-26 15:55:49,634 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701014149634"}]},"ts":"1701014149634"} 2023-11-26 15:55:49,634 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-11-26 15:55:49,637 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-11-26 15:55:49,638 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 871 msec 2023-11-26 15:55:49,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-26 15:55:49,873 INFO [Listener at localhost/43645] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-11-26 15:55:49,878 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:49,879 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:49,879 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:49,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:49,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-26 15:55:49,882 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-26 15:55:49,882 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:49,882 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-26 15:55:49,882 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-26 15:55:49,883 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:49,883 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:49,884 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:49,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:49,884 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:49,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:49,884 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:49,884 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:49,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:49,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:49,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:49,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:49,885 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-26 15:55:49,885 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-26 15:55:49,885 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-26 15:55:49,885 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:49,885 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-26 15:55:49,886 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:55:49,886 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. started... 2023-11-26 15:55:49,886 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:55:49,886 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-26 15:55:49,886 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:49,887 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2b5c98810f62b16839301eb6de0d4e23 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-26 15:55:49,886 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. started... 2023-11-26 15:55:49,886 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:55:49,887 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. started... 2023-11-26 15:55:49,887 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 905d5b9a6c25e80983010d7024fe6dea 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-26 15:55:49,888 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e7ba85103d9b5b3dd1d2b42cea0bd1fa 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-26 15:55:50,336 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126809b8fbbc2f34441900d049ed4d41724 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231126809b8fbbc2f34441900d049ed4d41724 2023-11-26 15:55:50,342 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231126e518a6fd116645a985252f015ae56e3b to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231126e518a6fd116645a985252f015ae56e3b 2023-11-26 15:55:50,343 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231126dccad8bc75b242ac8c098522e218b549 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231126dccad8bc75b242ac8c098522e218b549 2023-11-26 15:55:50,359 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family1/b84bb4720f334fc29200b602b514e541 2023-11-26 15:55:50,394 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231126086837006f1446e7bf74c8e76c8d1e74 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231126086837006f1446e7bf74c8e76c8d1e74 2023-11-26 15:55:50,398 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family2/afd4a76c27db4d97983ea03d12755441 2023-11-26 15:55:50,402 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family1/b84bb4720f334fc29200b602b514e541 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/b84bb4720f334fc29200b602b514e541 2023-11-26 15:55:50,427 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/b84bb4720f334fc29200b602b514e541, entries=4, sequenceid=5, filesize=5.5 K 2023-11-26 15:55:50,428 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family2/afd4a76c27db4d97983ea03d12755441 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/afd4a76c27db4d97983ea03d12755441 2023-11-26 15:55:50,432 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/afd4a76c27db4d97983ea03d12755441, entries=2, sequenceid=5, filesize=5.1 K 2023-11-26 15:55:50,432 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for e7ba85103d9b5b3dd1d2b42cea0bd1fa in 544ms, sequenceid=5, compaction requested=false 2023-11-26 15:55:50,433 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-26 15:55:50,433 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e7ba85103d9b5b3dd1d2b42cea0bd1fa: 2023-11-26 15:55:50,433 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:55:50,433 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-26 15:55:50,753 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family1/90a623b31273408abe55c57f273bcb1a 2023-11-26 15:55:50,759 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family1/e979b79046ce49e48c2ed3d32744148e 2023-11-26 15:55:51,185 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126bcb9bd47e20c4b60b77fd0bd758863f9 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231126bcb9bd47e20c4b60b77fd0bd758863f9 2023-11-26 15:55:51,191 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112619eda56a80f247239b62f7d49a8bf76b to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023112619eda56a80f247239b62f7d49a8bf76b 2023-11-26 15:55:51,590 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family2/6c954b0ef2b14c1faa307ecec501d835 2023-11-26 15:55:51,594 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family1/90a623b31273408abe55c57f273bcb1a as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/90a623b31273408abe55c57f273bcb1a 2023-11-26 15:55:51,595 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family2/0588a571b87c4ebea5bf41d84be89188 2023-11-26 15:55:51,598 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family1/e979b79046ce49e48c2ed3d32744148e as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/e979b79046ce49e48c2ed3d32744148e 2023-11-26 15:55:51,617 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/90a623b31273408abe55c57f273bcb1a, entries=4, sequenceid=5, filesize=5.5 K 2023-11-26 15:55:51,618 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family2/6c954b0ef2b14c1faa307ecec501d835 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/6c954b0ef2b14c1faa307ecec501d835 2023-11-26 15:55:51,620 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/6c954b0ef2b14c1faa307ecec501d835, entries=2, sequenceid=5, filesize=5.1 K 2023-11-26 15:55:51,621 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 2b5c98810f62b16839301eb6de0d4e23 in 1735ms, sequenceid=5, compaction requested=false 2023-11-26 15:55:51,621 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/e979b79046ce49e48c2ed3d32744148e, entries=4, sequenceid=5, filesize=5.5 K 2023-11-26 15:55:51,622 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2b5c98810f62b16839301eb6de0d4e23: 2023-11-26 15:55:51,622 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:55:51,622 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-26 15:55:51,622 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family2/0588a571b87c4ebea5bf41d84be89188 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/0588a571b87c4ebea5bf41d84be89188 2023-11-26 15:55:51,625 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/0588a571b87c4ebea5bf41d84be89188, entries=2, sequenceid=5, filesize=5.1 K 2023-11-26 15:55:51,626 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 905d5b9a6c25e80983010d7024fe6dea in 1739ms, sequenceid=5, compaction requested=false 2023-11-26 15:55:51,626 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 905d5b9a6c25e80983010d7024fe6dea: 2023-11-26 15:55:51,626 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:55:51,626 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-26 15:55:51,626 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-26 15:55:51,626 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:51,626 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-26 15:55:51,626 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-26 15:55:51,627 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:51,627 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:51,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:51,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:51,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:51,628 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:51,628 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:51,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:51,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:51,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:51,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:51,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:51,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-26 15:55:51,629 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47292b90[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:51,629 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-26 15:55:51,629 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:51,630 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:51,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:51,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:51,630 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-26 15:55:51,630 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-26 15:55:51,630 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:51,630 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:51,630 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:51,632 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-26 15:55:51,632 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:51,632 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:51,632 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-26 15:55:51,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:51,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:51,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:51,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:51,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:51,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:51,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:51,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:51,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:51,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:51,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:51,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-26 15:55:51,634 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-26 15:55:51,635 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:51,635 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:51,635 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-26 15:55:51,635 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:51,639 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:51,639 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:51,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:51,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:51,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:51,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:51,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:51,639 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:51,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:51,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:51,639 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:51,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:51,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:51,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:51,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:51,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:51,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:51,641 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:51,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:51,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:51,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:51,643 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:51,643 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:51,643 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:51,643 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:51,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:51,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-26 15:55:51,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:51,643 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:51,643 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:51,643 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:51,643 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:51,643 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:51,643 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:51,643 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:51,643 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:51,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:51,743 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:51,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:51,745 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:51,745 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:51,745 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:51,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:51,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-26 15:55:51,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-26 15:55:51,749 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-26 15:55:51,749 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:51,749 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-26 15:55:51,749 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-26 15:55:51,749 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:51,749 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:51,752 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:51,752 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:51,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:51,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:51,752 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:51,752 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:51,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:51,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:51,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:51,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:51,753 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-26 15:55:51,753 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-26 15:55:51,753 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-26 15:55:51,753 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-26 15:55:51,753 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:51,753 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-26 15:55:51,753 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:55:51,753 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:55:51,753 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-26 15:55:51,753 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:51,753 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. started... 2023-11-26 15:55:51,753 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:55:51,753 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. started... 2023-11-26 15:55:51,754 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. started... 2023-11-26 15:55:51,754 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2b5c98810f62b16839301eb6de0d4e23 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-26 15:55:51,754 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 905d5b9a6c25e80983010d7024fe6dea 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-26 15:55:51,754 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e7ba85103d9b5b3dd1d2b42cea0bd1fa 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-26 15:55:52,196 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311263577a2a421a144d294d84f0325b29126 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311263577a2a421a144d294d84f0325b29126 2023-11-26 15:55:52,203 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311260795fbc8bb0c4bca94888373685630ef to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311260795fbc8bb0c4bca94888373685630ef 2023-11-26 15:55:52,204 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311263e940b96953f403eae40c74c860a1d13 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311263e940b96953f403eae40c74c860a1d13 2023-11-26 15:55:52,219 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family1/7f3b4e365ebc41d6bbb0d28d4a0b411f 2023-11-26 15:55:52,248 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112670114747c19840b09b6ea50c457d5560 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023112670114747c19840b09b6ea50c457d5560 2023-11-26 15:55:52,611 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family1/a3ee75004a844a0db9384db9cc44a8dd 2023-11-26 15:55:52,617 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family1/3155ada53f654176bb40a06ac9b17436 2023-11-26 15:55:52,652 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family2/616e8ebf5cae4025a95e55b6efce6ebb 2023-11-26 15:55:52,655 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family1/7f3b4e365ebc41d6bbb0d28d4a0b411f as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/7f3b4e365ebc41d6bbb0d28d4a0b411f 2023-11-26 15:55:52,678 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/7f3b4e365ebc41d6bbb0d28d4a0b411f, entries=4, sequenceid=9, filesize=5.5 K 2023-11-26 15:55:52,678 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family2/616e8ebf5cae4025a95e55b6efce6ebb as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/616e8ebf5cae4025a95e55b6efce6ebb 2023-11-26 15:55:52,681 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/616e8ebf5cae4025a95e55b6efce6ebb, entries=2, sequenceid=9, filesize=5.1 K 2023-11-26 15:55:52,682 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 905d5b9a6c25e80983010d7024fe6dea in 928ms, sequenceid=9, compaction requested=false 2023-11-26 15:55:52,682 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 905d5b9a6c25e80983010d7024fe6dea: 2023-11-26 15:55:52,682 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:55:52,682 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-26 15:55:53,046 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126cb9f33d06a5d4e72afe104997efe2a98 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231126cb9f33d06a5d4e72afe104997efe2a98 2023-11-26 15:55:53,047 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311263192dec164d94b66b5084086dfe8032b to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311263192dec164d94b66b5084086dfe8032b 2023-11-26 15:55:53,451 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family2/8e3c7af0408f4a99b3fcf4d80223177d 2023-11-26 15:55:53,454 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family2/831335e7ccf04e2fa9f49df4e296e0ce 2023-11-26 15:55:53,455 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family1/a3ee75004a844a0db9384db9cc44a8dd as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/a3ee75004a844a0db9384db9cc44a8dd 2023-11-26 15:55:53,457 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family1/3155ada53f654176bb40a06ac9b17436 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/3155ada53f654176bb40a06ac9b17436 2023-11-26 15:55:53,478 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/a3ee75004a844a0db9384db9cc44a8dd, entries=4, sequenceid=9, filesize=5.5 K 2023-11-26 15:55:53,479 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family2/8e3c7af0408f4a99b3fcf4d80223177d as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/8e3c7af0408f4a99b3fcf4d80223177d 2023-11-26 15:55:53,481 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/3155ada53f654176bb40a06ac9b17436, entries=4, sequenceid=9, filesize=5.5 K 2023-11-26 15:55:53,482 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/8e3c7af0408f4a99b3fcf4d80223177d, entries=2, sequenceid=9, filesize=5.1 K 2023-11-26 15:55:53,482 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family2/831335e7ccf04e2fa9f49df4e296e0ce as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/831335e7ccf04e2fa9f49df4e296e0ce 2023-11-26 15:55:53,482 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 2b5c98810f62b16839301eb6de0d4e23 in 1728ms, sequenceid=9, compaction requested=false 2023-11-26 15:55:53,482 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2b5c98810f62b16839301eb6de0d4e23: 2023-11-26 15:55:53,482 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:55:53,482 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-26 15:55:53,485 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/831335e7ccf04e2fa9f49df4e296e0ce, entries=2, sequenceid=9, filesize=5.1 K 2023-11-26 15:55:53,486 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for e7ba85103d9b5b3dd1d2b42cea0bd1fa in 1732ms, sequenceid=9, compaction requested=false 2023-11-26 15:55:53,486 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e7ba85103d9b5b3dd1d2b42cea0bd1fa: 2023-11-26 15:55:53,486 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:55:53,486 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-26 15:55:53,486 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-26 15:55:53,486 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:53,486 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-26 15:55:53,486 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-26 15:55:53,487 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:53,487 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:53,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:53,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:53,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:53,488 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:53,488 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:53,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:53,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:53,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:53,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:53,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:53,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-26 15:55:53,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14e86d06[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:53,489 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-26 15:55:53,489 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:53,490 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:53,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:53,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:53,490 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-26 15:55:53,490 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-26 15:55:53,490 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:53,490 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:53,490 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:53,491 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-26 15:55:53,491 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:53,492 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:53,492 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-26 15:55:53,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:53,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:53,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:53,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:53,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:53,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:53,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:53,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:53,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:53,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:53,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:53,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-26 15:55:53,494 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-26 15:55:53,494 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:53,494 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:53,494 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-26 15:55:53,494 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:53,496 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:53,496 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:53,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:53,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:53,496 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:53,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:53,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:53,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:53,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:53,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:53,497 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:53,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:53,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:53,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:53,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:53,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:53,498 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:53,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:53,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:53,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:53,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:53,500 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:53,500 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:53,500 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:53,500 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:53,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:53,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-26 15:55:53,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:53,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:53,500 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:53,500 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:53,500 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:53,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-26 15:55:53,500 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:53,500 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:53,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:53,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:53,500 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:53,500 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:53,500 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:53,601 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:53,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:53,602 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:53,602 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:53,603 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:53,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:53,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-26 15:55:53,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-26 15:55:53,606 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-26 15:55:53,606 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:53,606 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-26 15:55:53,606 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-26 15:55:53,607 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:53,607 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:53,608 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:53,608 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:53,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:53,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:53,608 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:53,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:53,608 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:53,609 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:53,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:53,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:53,609 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-26 15:55:53,609 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-26 15:55:53,609 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-26 15:55:53,609 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-26 15:55:53,609 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:53,609 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-26 15:55:53,610 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:55:53,610 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. started... 2023-11-26 15:55:53,610 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:55:53,610 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. started... 2023-11-26 15:55:53,610 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2b5c98810f62b16839301eb6de0d4e23 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-26 15:55:53,610 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 905d5b9a6c25e80983010d7024fe6dea 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-26 15:55:53,611 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-26 15:55:53,611 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:53,611 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:55:53,611 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. started... 2023-11-26 15:55:53,611 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e7ba85103d9b5b3dd1d2b42cea0bd1fa 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-26 15:55:53,659 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231126d78ab93dc1814768b84490e3e09a8c76 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231126d78ab93dc1814768b84490e3e09a8c76 2023-11-26 15:55:53,677 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family1/e991037b3b19499493bdda907a807e31 2023-11-26 15:55:53,709 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311262eb31ccd752a45e3ba14ec4920c337dd to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311262eb31ccd752a45e3ba14ec4920c337dd 2023-11-26 15:55:53,713 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family2/e59d3d31316c4d5c82b0fc519efebc15 2023-11-26 15:55:53,716 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family1/e991037b3b19499493bdda907a807e31 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/e991037b3b19499493bdda907a807e31 2023-11-26 15:55:53,740 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/e991037b3b19499493bdda907a807e31, entries=4, sequenceid=13, filesize=5.5 K 2023-11-26 15:55:53,741 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family2/e59d3d31316c4d5c82b0fc519efebc15 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/e59d3d31316c4d5c82b0fc519efebc15 2023-11-26 15:55:53,745 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/e59d3d31316c4d5c82b0fc519efebc15, entries=2, sequenceid=13, filesize=5.1 K 2023-11-26 15:55:53,746 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for e7ba85103d9b5b3dd1d2b42cea0bd1fa in 135ms, sequenceid=13, compaction requested=true 2023-11-26 15:55:53,746 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e7ba85103d9b5b3dd1d2b42cea0bd1fa: 2023-11-26 15:55:53,746 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:55:53,746 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-26 15:55:54,053 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231126116d600ed5b8440a8b458678fd8dde30 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231126116d600ed5b8440a8b458678fd8dde30 2023-11-26 15:55:54,053 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311261ab236c21e7e4deda805a633cdc9b248 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311261ab236c21e7e4deda805a633cdc9b248 2023-11-26 15:55:54,084 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-26 15:55:54,084 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c909229 to 127.0.0.1:58210 2023-11-26 15:55:54,084 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:55:54,084 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-26 15:55:54,084 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06c8f92a to 127.0.0.1:58210 2023-11-26 15:55:54,084 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:55:54,469 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family1/6ef8bb0dfcbe431aab0589cf26a22543 2023-11-26 15:55:54,496 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family1/eb4854f64dd64009afb412b460b878f2 2023-11-26 15:55:54,508 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311261878c9973ef74dedb16db81a424149ce to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311261878c9973ef74dedb16db81a424149ce 2023-11-26 15:55:54,536 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023112660bdd11eb1c74b65bb63e230b5981eb3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023112660bdd11eb1c74b65bb63e230b5981eb3 2023-11-26 15:55:54,538 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family2/673e091913dd4644b5883f714fbddd2a 2023-11-26 15:55:54,543 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family1/6ef8bb0dfcbe431aab0589cf26a22543 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/6ef8bb0dfcbe431aab0589cf26a22543 2023-11-26 15:55:54,579 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/6ef8bb0dfcbe431aab0589cf26a22543, entries=4, sequenceid=13, filesize=5.5 K 2023-11-26 15:55:54,580 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family2/673e091913dd4644b5883f714fbddd2a as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/673e091913dd4644b5883f714fbddd2a 2023-11-26 15:55:54,584 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/673e091913dd4644b5883f714fbddd2a, entries=2, sequenceid=13, filesize=5.1 K 2023-11-26 15:55:54,585 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 2b5c98810f62b16839301eb6de0d4e23 in 975ms, sequenceid=13, compaction requested=true 2023-11-26 15:55:54,586 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2b5c98810f62b16839301eb6de0d4e23: 2023-11-26 15:55:54,586 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:55:54,586 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-26 15:55:54,950 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family2/46a78fb7c0394421a351e75f0ed92193 2023-11-26 15:55:54,956 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family1/eb4854f64dd64009afb412b460b878f2 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/eb4854f64dd64009afb412b460b878f2 2023-11-26 15:55:54,984 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/eb4854f64dd64009afb412b460b878f2, entries=4, sequenceid=13, filesize=5.5 K 2023-11-26 15:55:54,985 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family2/46a78fb7c0394421a351e75f0ed92193 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/46a78fb7c0394421a351e75f0ed92193 2023-11-26 15:55:54,989 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/46a78fb7c0394421a351e75f0ed92193, entries=2, sequenceid=13, filesize=5.1 K 2023-11-26 15:55:54,991 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 905d5b9a6c25e80983010d7024fe6dea in 1381ms, sequenceid=13, compaction requested=true 2023-11-26 15:55:54,991 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 905d5b9a6c25e80983010d7024fe6dea: 2023-11-26 15:55:54,991 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:55:54,991 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-26 15:55:54,991 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-26 15:55:54,991 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:54,991 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-26 15:55:54,991 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-26 15:55:54,993 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:54,993 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:54,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:54,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:54,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:54,994 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:54,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:54,995 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:54,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:54,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:54,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:54,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:54,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-26 15:55:54,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@281502e5[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:54,997 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-26 15:55:54,997 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:54,998 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:54,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:54,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:54,999 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-26 15:55:54,999 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-26 15:55:54,999 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:54,999 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:54,999 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:55,000 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:55,000 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-26 15:55:55,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:55,001 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:55,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:55,001 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-26 15:55:55,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:55,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:55,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:55,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:55,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:55,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:55,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:55,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:55,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:55,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-26 15:55:55,006 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-26 15:55:55,006 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:55,006 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:55,006 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-26 15:55:55,006 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:55,009 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:55,009 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:55,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:55,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:55,009 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:55,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:55,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:55,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:55,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:55,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:55,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:55,010 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:55,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:55,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:55,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:55,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:55,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:55,011 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:55,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:55,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:55,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:55,014 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:55,014 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:55,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:55,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:55,015 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:55,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-26 15:55:55,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:55,015 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:55,015 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:55,015 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:55,015 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:55,015 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:55,015 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:55,015 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:55,015 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:55,015 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:55,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:55,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:55,080 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-26 15:55:55,116 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:55,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:55,117 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:55,118 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:55,118 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. with WAL disabled. Data may be lost in the event of a crash. 2023-11-26 15:55:55,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:55,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-26 15:55:55,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-26 15:55:55,122 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-26 15:55:55,122 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:55,122 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-26 15:55:55,122 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-26 15:55:55,122 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:55,122 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:55,123 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:55,123 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:55,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:55,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:55,124 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:55,124 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:55,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:55,125 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:55,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:55,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:55,125 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-26 15:55:55,125 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-26 15:55:55,125 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-26 15:55:55,126 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-26 15:55:55,126 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:55,126 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-26 15:55:55,126 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:55:55,126 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. started... 2023-11-26 15:55:55,126 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:55:55,126 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2b5c98810f62b16839301eb6de0d4e23 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-26 15:55:55,126 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. started... 2023-11-26 15:55:55,126 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 905d5b9a6c25e80983010d7024fe6dea 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-26 15:55:55,128 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-26 15:55:55,128 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:55,128 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:55:55,128 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. started... 2023-11-26 15:55:55,128 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e7ba85103d9b5b3dd1d2b42cea0bd1fa 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-26 15:55:55,187 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311262a5ed192eb6649f48197953fadcf17da to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311262a5ed192eb6649f48197953fadcf17da 2023-11-26 15:55:55,193 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126341f26da5f45458a8d36aeb49d6f9a14 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231126341f26da5f45458a8d36aeb49d6f9a14 2023-11-26 15:55:55,220 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family1/7787b66334c84f86a8dbea94f226bc78 2023-11-26 15:55:55,229 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family1/32545d9a99684edbbb2457a8a5b1c43f 2023-11-26 15:55:55,278 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126083b4f082d3a4c6abc0fce681ece50a3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231126083b4f082d3a4c6abc0fce681ece50a3 2023-11-26 15:55:55,289 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family2/620c24023eb948d2bd7b3673c6903531 2023-11-26 15:55:55,295 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family1/7787b66334c84f86a8dbea94f226bc78 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/7787b66334c84f86a8dbea94f226bc78 2023-11-26 15:55:55,325 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/7787b66334c84f86a8dbea94f226bc78, entries=4, sequenceid=17, filesize=5.5 K 2023-11-26 15:55:55,326 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family2/620c24023eb948d2bd7b3673c6903531 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/620c24023eb948d2bd7b3673c6903531 2023-11-26 15:55:55,331 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/620c24023eb948d2bd7b3673c6903531, entries=2, sequenceid=17, filesize=5.1 K 2023-11-26 15:55:55,332 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 2b5c98810f62b16839301eb6de0d4e23 in 206ms, sequenceid=17, compaction requested=true 2023-11-26 15:55:55,332 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2b5c98810f62b16839301eb6de0d4e23: 2023-11-26 15:55:55,332 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:55:55,332 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-26 15:55:55,586 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231126b1a2bce9c3a54968a0a29828e6d28517 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231126b1a2bce9c3a54968a0a29828e6d28517 2023-11-26 15:55:55,693 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231126692e0a33e9d74b759d83178db108cbeb to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231126692e0a33e9d74b759d83178db108cbeb 2023-11-26 15:55:55,697 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family2/16908d83faec4bb9a04ded4ec4bc19b1 2023-11-26 15:55:55,701 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family1/32545d9a99684edbbb2457a8a5b1c43f as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/32545d9a99684edbbb2457a8a5b1c43f 2023-11-26 15:55:55,724 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/32545d9a99684edbbb2457a8a5b1c43f, entries=4, sequenceid=17, filesize=5.5 K 2023-11-26 15:55:55,725 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family2/16908d83faec4bb9a04ded4ec4bc19b1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/16908d83faec4bb9a04ded4ec4bc19b1 2023-11-26 15:55:55,729 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/16908d83faec4bb9a04ded4ec4bc19b1, entries=2, sequenceid=17, filesize=5.1 K 2023-11-26 15:55:55,729 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for e7ba85103d9b5b3dd1d2b42cea0bd1fa in 601ms, sequenceid=17, compaction requested=true 2023-11-26 15:55:55,730 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e7ba85103d9b5b3dd1d2b42cea0bd1fa: 2023-11-26 15:55:55,730 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:55:55,730 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-26 15:55:56,000 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family1/fb6e20fa2eb74e598e61d4023cd9dc2f 2023-11-26 15:55:56,434 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231126a7be5f3504b64bdc85c1eb5bdb24e3d1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231126a7be5f3504b64bdc85c1eb5bdb24e3d1 2023-11-26 15:55:56,442 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family2/7bad699043e140adba564e9de7dafb8a 2023-11-26 15:55:56,447 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family1/fb6e20fa2eb74e598e61d4023cd9dc2f as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/fb6e20fa2eb74e598e61d4023cd9dc2f 2023-11-26 15:55:56,480 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/fb6e20fa2eb74e598e61d4023cd9dc2f, entries=4, sequenceid=17, filesize=5.5 K 2023-11-26 15:55:56,484 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family2/7bad699043e140adba564e9de7dafb8a as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/7bad699043e140adba564e9de7dafb8a 2023-11-26 15:55:56,488 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/7bad699043e140adba564e9de7dafb8a, entries=2, sequenceid=17, filesize=5.1 K 2023-11-26 15:55:56,489 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 905d5b9a6c25e80983010d7024fe6dea in 1363ms, sequenceid=17, compaction requested=true 2023-11-26 15:55:56,489 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 905d5b9a6c25e80983010d7024fe6dea: 2023-11-26 15:55:56,489 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:55:56,489 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-26 15:55:56,489 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-26 15:55:56,489 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:56,490 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-26 15:55:56,490 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-26 15:55:56,491 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:56,491 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:56,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:56,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:56,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:56,492 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:56,492 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:56,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:56,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:56,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:56,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:56,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:56,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-26 15:55:56,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36c19bd1[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:56,495 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-26 15:55:56,495 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:56,500 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:56,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:56,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:56,500 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-26 15:55:56,501 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-26 15:55:56,501 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:56,501 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:56,501 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:56,502 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-26 15:55:56,502 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:56,502 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:56,502 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-26 15:55:56,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:56,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:56,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:56,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:56,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:56,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:56,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:56,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:56,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:56,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:56,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:56,507 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-26 15:55:56,507 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-26 15:55:56,507 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:56,507 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:56,507 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-26 15:55:56,507 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:56,509 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:56,509 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:56,509 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:56,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:56,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:56,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:56,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:56,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:56,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:56,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:56,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:56,510 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:56,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:56,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:56,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:56,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:56,511 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:56,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:56,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:56,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:56,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:56,515 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:56,515 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:56,515 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:56,515 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:56,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-26 15:55:56,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:56,515 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:56,515 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:56,515 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:56,515 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:56,515 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:56,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-26 15:55:56,515 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:56,515 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:56,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:56,515 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:56,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:56,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:56,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:56,616 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:56,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:56,626 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:55:56,632 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:55:56,639 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:55:56,639 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:55:56,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-26 15:55:56,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-26 15:55:56,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-26 15:55:56,723 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-26 15:55:56,723 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:56,723 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-26 15:55:56,723 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-26 15:55:56,724 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:56,724 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:56,725 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:56,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:56,725 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:56,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:56,725 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:56,726 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-26 15:55:56,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:56,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:56,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-26 15:55:56,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:56,726 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-26 15:55:56,731 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-26 15:55:56,731 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-26 15:55:56,731 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-26 15:55:56,731 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-26 15:55:56,731 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-26 15:55:56,732 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:55:56,732 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-26 15:55:56,732 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:55:56,732 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:55:56,732 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. started... 2023-11-26 15:55:56,732 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-26 15:55:56,732 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. started... 2023-11-26 15:55:56,732 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 905d5b9a6c25e80983010d7024fe6dea 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-26 15:55:56,732 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. started... 2023-11-26 15:55:56,732 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2b5c98810f62b16839301eb6de0d4e23 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-26 15:55:56,732 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing e7ba85103d9b5b3dd1d2b42cea0bd1fa 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-26 15:55:56,770 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family1/6b45184bb5ff47aeb3f77ef9eadc3501 2023-11-26 15:55:56,786 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family1/8723f331ae1549069e2224eb2d1162e1 2023-11-26 15:55:56,793 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6b45184bb5ff47aeb3f77ef9eadc3501 2023-11-26 15:55:56,811 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8723f331ae1549069e2224eb2d1162e1 2023-11-26 15:55:56,819 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family2/dacaa7f1436849d89d463a4004e28cf6 2023-11-26 15:55:56,821 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dacaa7f1436849d89d463a4004e28cf6 2023-11-26 15:55:56,822 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family1/8723f331ae1549069e2224eb2d1162e1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/8723f331ae1549069e2224eb2d1162e1 2023-11-26 15:55:56,843 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8723f331ae1549069e2224eb2d1162e1 2023-11-26 15:55:56,843 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/8723f331ae1549069e2224eb2d1162e1, entries=3, sequenceid=23, filesize=5.2 K 2023-11-26 15:55:56,844 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family2/dacaa7f1436849d89d463a4004e28cf6 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/dacaa7f1436849d89d463a4004e28cf6 2023-11-26 15:55:56,846 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dacaa7f1436849d89d463a4004e28cf6 2023-11-26 15:55:56,846 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/dacaa7f1436849d89d463a4004e28cf6, entries=1, sequenceid=23, filesize=5.0 K 2023-11-26 15:55:56,847 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 905d5b9a6c25e80983010d7024fe6dea in 115ms, sequenceid=23, compaction requested=true 2023-11-26 15:55:56,847 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 905d5b9a6c25e80983010d7024fe6dea: 2023-11-26 15:55:56,847 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:55:56,847 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-26 15:55:57,179 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family1/f5eab8b318364af1bbd80ed5598c54fe 2023-11-26 15:55:57,202 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f5eab8b318364af1bbd80ed5598c54fe 2023-11-26 15:55:57,202 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family2/3092d1f1cf8a48d89739646a16c1f41c 2023-11-26 15:55:57,207 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3092d1f1cf8a48d89739646a16c1f41c 2023-11-26 15:55:57,208 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family1/6b45184bb5ff47aeb3f77ef9eadc3501 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/6b45184bb5ff47aeb3f77ef9eadc3501 2023-11-26 15:55:57,230 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6b45184bb5ff47aeb3f77ef9eadc3501 2023-11-26 15:55:57,230 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/6b45184bb5ff47aeb3f77ef9eadc3501, entries=3, sequenceid=23, filesize=5.2 K 2023-11-26 15:55:57,230 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family2/3092d1f1cf8a48d89739646a16c1f41c as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/3092d1f1cf8a48d89739646a16c1f41c 2023-11-26 15:55:57,236 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3092d1f1cf8a48d89739646a16c1f41c 2023-11-26 15:55:57,236 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/3092d1f1cf8a48d89739646a16c1f41c, entries=1, sequenceid=23, filesize=5.0 K 2023-11-26 15:55:57,236 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 2b5c98810f62b16839301eb6de0d4e23 in 504ms, sequenceid=23, compaction requested=true 2023-11-26 15:55:57,236 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2b5c98810f62b16839301eb6de0d4e23: 2023-11-26 15:55:57,236 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:55:57,236 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-26 15:55:58,015 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family2/11c7e81dae6a4614a173224aab3a25c4 2023-11-26 15:55:58,018 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 11c7e81dae6a4614a173224aab3a25c4 2023-11-26 15:55:58,019 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family1/f5eab8b318364af1bbd80ed5598c54fe as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/f5eab8b318364af1bbd80ed5598c54fe 2023-11-26 15:55:58,043 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f5eab8b318364af1bbd80ed5598c54fe 2023-11-26 15:55:58,043 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/f5eab8b318364af1bbd80ed5598c54fe, entries=3, sequenceid=23, filesize=5.2 K 2023-11-26 15:55:58,044 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family2/11c7e81dae6a4614a173224aab3a25c4 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/11c7e81dae6a4614a173224aab3a25c4 2023-11-26 15:55:58,048 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 11c7e81dae6a4614a173224aab3a25c4 2023-11-26 15:55:58,048 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/11c7e81dae6a4614a173224aab3a25c4, entries=1, sequenceid=23, filesize=5.0 K 2023-11-26 15:55:58,049 INFO [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for e7ba85103d9b5b3dd1d2b42cea0bd1fa in 1317ms, sequenceid=23, compaction requested=true 2023-11-26 15:55:58,049 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for e7ba85103d9b5b3dd1d2b42cea0bd1fa: 2023-11-26 15:55:58,049 DEBUG [rs(jenkins-hbase4.apache.org,41861,1701014000937)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:55:58,049 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-26 15:55:58,049 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-26 15:55:58,049 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:58,049 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-26 15:55:58,049 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-26 15:55:58,051 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:58,051 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:58,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:58,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:58,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:58,051 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:58,051 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-26 15:55:58,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:58,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:58,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:58,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:58,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:58,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41861,1701014000937' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-26 15:55:58,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38ba4332[Count = 0] remaining members to acquire global barrier 2023-11-26 15:55:58,053 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-26 15:55:58,053 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:58,055 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:58,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:58,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:58,055 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-26 15:55:58,055 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-26 15:55:58,055 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,41861,1701014000937' in zk 2023-11-26 15:55:58,055 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:58,055 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-26 15:55:58,057 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-26 15:55:58,057 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:58,057 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:58,057 DEBUG [member: 'jenkins-hbase4.apache.org,41861,1701014000937' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-26 15:55:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:58,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:58,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:58,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:58,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:58,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:58,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,41861,1701014000937': 2023-11-26 15:55:58,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41861,1701014000937' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-26 15:55:58,060 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-26 15:55:58,060 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-26 15:55:58,060 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-26 15:55:58,060 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-26 15:55:58,060 INFO [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-26 15:55:58,062 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:58,062 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:58,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:58,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-26 15:55:58,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-26 15:55:58,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:58,062 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:58,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:58,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-26 15:55:58,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:58,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:58,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:58,063 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:58,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:58,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-26 15:55:58,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:58,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:58,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-26 15:55:58,064 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:58,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-26 15:55:58,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:58,067 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:58,068 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:58,068 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-26 15:55:58,068 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-26 15:55:58,068 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:55:58,068 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-26 15:55:58,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-26 15:55:58,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-26 15:55:58,068 DEBUG [(jenkins-hbase4.apache.org,33415,1701013999777)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-26 15:55:58,068 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:58,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-26 15:55:58,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-26 15:55:58,068 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-26 15:55:58,068 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-26 15:55:58,068 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-26 15:55:58,068 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-26 15:55:58,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-26 15:55:58,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-26 15:55:58,168 DEBUG [Listener at localhost/43645] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-26 15:55:58,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33415] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-26 15:55:58,170 DEBUG [Listener at localhost/43645] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-26 15:55:58,170 DEBUG [Listener at localhost/43645] regionserver.HStore(1912): 2b5c98810f62b16839301eb6de0d4e23/family1 is initiating major compaction (all files) 2023-11-26 15:55:58,170 INFO [Listener at localhost/43645] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-26 15:55:58,170 INFO [Listener at localhost/43645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:55:58,170 INFO [Listener at localhost/43645] regionserver.HRegion(2259): Starting compaction of 2b5c98810f62b16839301eb6de0d4e23/family1 in testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:55:58,171 INFO [Listener at localhost/43645] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/90a623b31273408abe55c57f273bcb1a, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/a3ee75004a844a0db9384db9cc44a8dd, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/6ef8bb0dfcbe431aab0589cf26a22543, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/7787b66334c84f86a8dbea94f226bc78, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/6b45184bb5ff47aeb3f77ef9eadc3501] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp, totalSize=27.1 K 2023-11-26 15:55:58,171 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 90a623b31273408abe55c57f273bcb1a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014149879 2023-11-26 15:55:58,172 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting a3ee75004a844a0db9384db9cc44a8dd, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014151745 2023-11-26 15:55:58,172 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 6ef8bb0dfcbe431aab0589cf26a22543, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014153603 2023-11-26 15:55:58,173 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 7787b66334c84f86a8dbea94f226bc78, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014155118 2023-11-26 15:55:58,173 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 6b45184bb5ff47aeb3f77ef9eadc3501, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-26 15:55:58,184 INFO [Listener at localhost/43645] throttle.PressureAwareThroughputController(145): 2b5c98810f62b16839301eb6de0d4e23#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:58,637 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023112600a107f868ae4c4c8e4ffc067654c99b_del 2023-11-26 15:55:58,637 INFO [Listener at localhost/43645] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023112600a107f868ae4c4c8e4ffc067654c99b_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023112600a107f868ae4c4c8e4ffc067654c99b_del 2023-11-26 15:55:59,110 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 47b9df8b9b1a44db9e5bc1e0d13bdc66 2023-11-26 15:55:59,110 DEBUG [Listener at localhost/43645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family1/47b9df8b9b1a44db9e5bc1e0d13bdc66 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/47b9df8b9b1a44db9e5bc1e0d13bdc66 2023-11-26 15:55:59,133 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 47b9df8b9b1a44db9e5bc1e0d13bdc66 2023-11-26 15:55:59,134 INFO [Listener at localhost/43645] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2b5c98810f62b16839301eb6de0d4e23/family1 of 2b5c98810f62b16839301eb6de0d4e23 into 47b9df8b9b1a44db9e5bc1e0d13bdc66(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:55:59,134 DEBUG [Listener at localhost/43645] regionserver.HRegion(2289): Compaction status journal for 2b5c98810f62b16839301eb6de0d4e23: 2023-11-26 15:55:59,134 DEBUG [Listener at localhost/43645] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-26 15:55:59,134 DEBUG [Listener at localhost/43645] regionserver.HStore(1912): 2b5c98810f62b16839301eb6de0d4e23/family2 is initiating major compaction (all files) 2023-11-26 15:55:59,134 INFO [Listener at localhost/43645] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-26 15:55:59,135 INFO [Listener at localhost/43645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:55:59,135 INFO [Listener at localhost/43645] regionserver.HRegion(2259): Starting compaction of 2b5c98810f62b16839301eb6de0d4e23/family2 in testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:55:59,135 INFO [Listener at localhost/43645] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/6c954b0ef2b14c1faa307ecec501d835, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/8e3c7af0408f4a99b3fcf4d80223177d, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/673e091913dd4644b5883f714fbddd2a, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/620c24023eb948d2bd7b3673c6903531, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/3092d1f1cf8a48d89739646a16c1f41c] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp, totalSize=25.4 K 2023-11-26 15:55:59,135 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 6c954b0ef2b14c1faa307ecec501d835, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014149879 2023-11-26 15:55:59,136 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 8e3c7af0408f4a99b3fcf4d80223177d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014151745 2023-11-26 15:55:59,136 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 673e091913dd4644b5883f714fbddd2a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014153603 2023-11-26 15:55:59,136 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 620c24023eb948d2bd7b3673c6903531, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014155118 2023-11-26 15:55:59,137 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 3092d1f1cf8a48d89739646a16c1f41c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-26 15:55:59,147 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/90a623b31273408abe55c57f273bcb1a, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/a3ee75004a844a0db9384db9cc44a8dd, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/6ef8bb0dfcbe431aab0589cf26a22543, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/7787b66334c84f86a8dbea94f226bc78, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/6b45184bb5ff47aeb3f77ef9eadc3501] to archive 2023-11-26 15:55:59,148 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:55:59,148 INFO [Listener at localhost/43645] throttle.PressureAwareThroughputController(145): 2b5c98810f62b16839301eb6de0d4e23#family2#compaction#199 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:55:59,149 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/90a623b31273408abe55c57f273bcb1a to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/90a623b31273408abe55c57f273bcb1a 2023-11-26 15:55:59,151 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/a3ee75004a844a0db9384db9cc44a8dd to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/a3ee75004a844a0db9384db9cc44a8dd 2023-11-26 15:55:59,152 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/6ef8bb0dfcbe431aab0589cf26a22543 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/6ef8bb0dfcbe431aab0589cf26a22543 2023-11-26 15:55:59,153 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/7787b66334c84f86a8dbea94f226bc78 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/7787b66334c84f86a8dbea94f226bc78 2023-11-26 15:55:59,154 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/6b45184bb5ff47aeb3f77ef9eadc3501 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/6b45184bb5ff47aeb3f77ef9eadc3501 2023-11-26 15:55:59,157 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231126bba1986c65b54aa3a0009402eb757550_del 2023-11-26 15:55:59,157 INFO [Listener at localhost/43645] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126bba1986c65b54aa3a0009402eb757550_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231126bba1986c65b54aa3a0009402eb757550_del 2023-11-26 15:55:59,969 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 674cfe8339384be1b6ef1f0c39e9dcec 2023-11-26 15:55:59,970 DEBUG [Listener at localhost/43645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/.tmp/family2/674cfe8339384be1b6ef1f0c39e9dcec as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/674cfe8339384be1b6ef1f0c39e9dcec 2023-11-26 15:55:59,972 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 674cfe8339384be1b6ef1f0c39e9dcec 2023-11-26 15:55:59,973 INFO [Listener at localhost/43645] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2b5c98810f62b16839301eb6de0d4e23/family2 of 2b5c98810f62b16839301eb6de0d4e23 into 674cfe8339384be1b6ef1f0c39e9dcec(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:55:59,973 DEBUG [Listener at localhost/43645] regionserver.HRegion(2289): Compaction status journal for 2b5c98810f62b16839301eb6de0d4e23: 2023-11-26 15:55:59,973 DEBUG [Listener at localhost/43645] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-26 15:55:59,974 DEBUG [Listener at localhost/43645] regionserver.HStore(1912): 905d5b9a6c25e80983010d7024fe6dea/family1 is initiating major compaction (all files) 2023-11-26 15:55:59,974 INFO [Listener at localhost/43645] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-26 15:55:59,974 INFO [Listener at localhost/43645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:55:59,974 INFO [Listener at localhost/43645] regionserver.HRegion(2259): Starting compaction of 905d5b9a6c25e80983010d7024fe6dea/family1 in testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:55:59,974 INFO [Listener at localhost/43645] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/e979b79046ce49e48c2ed3d32744148e, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/7f3b4e365ebc41d6bbb0d28d4a0b411f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/eb4854f64dd64009afb412b460b878f2, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/fb6e20fa2eb74e598e61d4023cd9dc2f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/8723f331ae1549069e2224eb2d1162e1] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp, totalSize=27.1 K 2023-11-26 15:55:59,975 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting e979b79046ce49e48c2ed3d32744148e, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014149879 2023-11-26 15:55:59,975 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 7f3b4e365ebc41d6bbb0d28d4a0b411f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014151745 2023-11-26 15:55:59,975 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting eb4854f64dd64009afb412b460b878f2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014153602 2023-11-26 15:55:59,976 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting fb6e20fa2eb74e598e61d4023cd9dc2f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014155118 2023-11-26 15:55:59,976 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 8723f331ae1549069e2224eb2d1162e1, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-26 15:55:59,983 INFO [Listener at localhost/43645] throttle.PressureAwareThroughputController(145): 905d5b9a6c25e80983010d7024fe6dea#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:56:00,046 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/6c954b0ef2b14c1faa307ecec501d835, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/8e3c7af0408f4a99b3fcf4d80223177d, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/673e091913dd4644b5883f714fbddd2a, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/620c24023eb948d2bd7b3673c6903531, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/3092d1f1cf8a48d89739646a16c1f41c] to archive 2023-11-26 15:56:00,048 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:56:00,050 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/6c954b0ef2b14c1faa307ecec501d835 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/6c954b0ef2b14c1faa307ecec501d835 2023-11-26 15:56:00,051 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/8e3c7af0408f4a99b3fcf4d80223177d to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/8e3c7af0408f4a99b3fcf4d80223177d 2023-11-26 15:56:00,052 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/673e091913dd4644b5883f714fbddd2a to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/673e091913dd4644b5883f714fbddd2a 2023-11-26 15:56:00,053 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/620c24023eb948d2bd7b3673c6903531 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/620c24023eb948d2bd7b3673c6903531 2023-11-26 15:56:00,054 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/3092d1f1cf8a48d89739646a16c1f41c to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family2/3092d1f1cf8a48d89739646a16c1f41c 2023-11-26 15:56:00,423 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311266997d87d87344203abbe53f743f80393_del 2023-11-26 15:56:00,423 INFO [Listener at localhost/43645] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311266997d87d87344203abbe53f743f80393_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311266997d87d87344203abbe53f743f80393_del 2023-11-26 15:56:00,479 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cc459c1ed4f245b8a266005d8e0936da 2023-11-26 15:56:00,480 DEBUG [Listener at localhost/43645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family1/cc459c1ed4f245b8a266005d8e0936da as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/cc459c1ed4f245b8a266005d8e0936da 2023-11-26 15:56:00,500 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cc459c1ed4f245b8a266005d8e0936da 2023-11-26 15:56:00,501 INFO [Listener at localhost/43645] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 905d5b9a6c25e80983010d7024fe6dea/family1 of 905d5b9a6c25e80983010d7024fe6dea into cc459c1ed4f245b8a266005d8e0936da(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:56:00,501 DEBUG [Listener at localhost/43645] regionserver.HRegion(2289): Compaction status journal for 905d5b9a6c25e80983010d7024fe6dea: 2023-11-26 15:56:00,501 DEBUG [Listener at localhost/43645] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-26 15:56:00,501 DEBUG [Listener at localhost/43645] regionserver.HStore(1912): 905d5b9a6c25e80983010d7024fe6dea/family2 is initiating major compaction (all files) 2023-11-26 15:56:00,501 INFO [Listener at localhost/43645] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-26 15:56:00,502 INFO [Listener at localhost/43645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:56:00,503 INFO [Listener at localhost/43645] regionserver.HRegion(2259): Starting compaction of 905d5b9a6c25e80983010d7024fe6dea/family2 in testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:56:00,503 INFO [Listener at localhost/43645] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/0588a571b87c4ebea5bf41d84be89188, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/616e8ebf5cae4025a95e55b6efce6ebb, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/46a78fb7c0394421a351e75f0ed92193, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/7bad699043e140adba564e9de7dafb8a, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/dacaa7f1436849d89d463a4004e28cf6] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp, totalSize=25.4 K 2023-11-26 15:56:00,503 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 0588a571b87c4ebea5bf41d84be89188, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014149879 2023-11-26 15:56:00,504 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 616e8ebf5cae4025a95e55b6efce6ebb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014151745 2023-11-26 15:56:00,505 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 46a78fb7c0394421a351e75f0ed92193, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014153602 2023-11-26 15:56:00,505 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 7bad699043e140adba564e9de7dafb8a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014155118 2023-11-26 15:56:00,505 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting dacaa7f1436849d89d463a4004e28cf6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-26 15:56:00,512 INFO [Listener at localhost/43645] throttle.PressureAwareThroughputController(145): 905d5b9a6c25e80983010d7024fe6dea#family2#compaction#201 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:56:00,546 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/e979b79046ce49e48c2ed3d32744148e, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/7f3b4e365ebc41d6bbb0d28d4a0b411f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/eb4854f64dd64009afb412b460b878f2, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/fb6e20fa2eb74e598e61d4023cd9dc2f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/8723f331ae1549069e2224eb2d1162e1] to archive 2023-11-26 15:56:00,547 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:56:00,548 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/e979b79046ce49e48c2ed3d32744148e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/e979b79046ce49e48c2ed3d32744148e 2023-11-26 15:56:00,550 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/7f3b4e365ebc41d6bbb0d28d4a0b411f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/7f3b4e365ebc41d6bbb0d28d4a0b411f 2023-11-26 15:56:00,550 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/eb4854f64dd64009afb412b460b878f2 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/eb4854f64dd64009afb412b460b878f2 2023-11-26 15:56:00,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/fb6e20fa2eb74e598e61d4023cd9dc2f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/fb6e20fa2eb74e598e61d4023cd9dc2f 2023-11-26 15:56:00,553 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/8723f331ae1549069e2224eb2d1162e1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/8723f331ae1549069e2224eb2d1162e1 2023-11-26 15:56:00,920 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311260ff704bba4794b1488bcf0cb7dede4fc_del 2023-11-26 15:56:00,920 INFO [Listener at localhost/43645] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311260ff704bba4794b1488bcf0cb7dede4fc_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311260ff704bba4794b1488bcf0cb7dede4fc_del 2023-11-26 15:56:00,931 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7428514eb11c4e98aeb704bda51e0f00 2023-11-26 15:56:00,932 DEBUG [Listener at localhost/43645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/.tmp/family2/7428514eb11c4e98aeb704bda51e0f00 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/7428514eb11c4e98aeb704bda51e0f00 2023-11-26 15:56:00,935 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7428514eb11c4e98aeb704bda51e0f00 2023-11-26 15:56:00,935 INFO [Listener at localhost/43645] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 905d5b9a6c25e80983010d7024fe6dea/family2 of 905d5b9a6c25e80983010d7024fe6dea into 7428514eb11c4e98aeb704bda51e0f00(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:56:00,935 DEBUG [Listener at localhost/43645] regionserver.HRegion(2289): Compaction status journal for 905d5b9a6c25e80983010d7024fe6dea: 2023-11-26 15:56:00,935 DEBUG [Listener at localhost/43645] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-26 15:56:00,936 DEBUG [Listener at localhost/43645] regionserver.HStore(1912): e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1 is initiating major compaction (all files) 2023-11-26 15:56:00,936 INFO [Listener at localhost/43645] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-26 15:56:00,936 INFO [Listener at localhost/43645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:56:00,936 INFO [Listener at localhost/43645] regionserver.HRegion(2259): Starting compaction of e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1 in testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:56:00,936 INFO [Listener at localhost/43645] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/b84bb4720f334fc29200b602b514e541, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/3155ada53f654176bb40a06ac9b17436, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/e991037b3b19499493bdda907a807e31, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/32545d9a99684edbbb2457a8a5b1c43f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/f5eab8b318364af1bbd80ed5598c54fe] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp, totalSize=27.1 K 2023-11-26 15:56:00,936 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting b84bb4720f334fc29200b602b514e541, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014149878 2023-11-26 15:56:00,937 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 3155ada53f654176bb40a06ac9b17436, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014151745 2023-11-26 15:56:00,937 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting e991037b3b19499493bdda907a807e31, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014153602 2023-11-26 15:56:00,937 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 32545d9a99684edbbb2457a8a5b1c43f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014155117 2023-11-26 15:56:00,937 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting f5eab8b318364af1bbd80ed5598c54fe, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-26 15:56:00,944 INFO [Listener at localhost/43645] throttle.PressureAwareThroughputController(145): e7ba85103d9b5b3dd1d2b42cea0bd1fa#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:56:00,947 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/0588a571b87c4ebea5bf41d84be89188, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/616e8ebf5cae4025a95e55b6efce6ebb, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/46a78fb7c0394421a351e75f0ed92193, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/7bad699043e140adba564e9de7dafb8a, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/dacaa7f1436849d89d463a4004e28cf6] to archive 2023-11-26 15:56:00,947 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:56:00,949 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/0588a571b87c4ebea5bf41d84be89188 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/0588a571b87c4ebea5bf41d84be89188 2023-11-26 15:56:00,949 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/616e8ebf5cae4025a95e55b6efce6ebb to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/616e8ebf5cae4025a95e55b6efce6ebb 2023-11-26 15:56:00,950 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/46a78fb7c0394421a351e75f0ed92193 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/46a78fb7c0394421a351e75f0ed92193 2023-11-26 15:56:00,951 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/7bad699043e140adba564e9de7dafb8a to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/7bad699043e140adba564e9de7dafb8a 2023-11-26 15:56:00,952 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/dacaa7f1436849d89d463a4004e28cf6 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family2/dacaa7f1436849d89d463a4004e28cf6 2023-11-26 15:56:01,381 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023112650c5fe98b8624915ae6d6a770f4b4695_del 2023-11-26 15:56:01,381 INFO [Listener at localhost/43645] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023112650c5fe98b8624915ae6d6a770f4b4695_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023112650c5fe98b8624915ae6d6a770f4b4695_del 2023-11-26 15:56:02,233 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 413259c7eed64efba1c06b1d713c4623 2023-11-26 15:56:02,234 DEBUG [Listener at localhost/43645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family1/413259c7eed64efba1c06b1d713c4623 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/413259c7eed64efba1c06b1d713c4623 2023-11-26 15:56:02,256 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 413259c7eed64efba1c06b1d713c4623 2023-11-26 15:56:02,257 INFO [Listener at localhost/43645] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1 of e7ba85103d9b5b3dd1d2b42cea0bd1fa into 413259c7eed64efba1c06b1d713c4623(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-26 15:56:02,257 DEBUG [Listener at localhost/43645] regionserver.HRegion(2289): Compaction status journal for e7ba85103d9b5b3dd1d2b42cea0bd1fa: 2023-11-26 15:56:02,257 DEBUG [Listener at localhost/43645] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-26 15:56:02,257 DEBUG [Listener at localhost/43645] regionserver.HStore(1912): e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2 is initiating major compaction (all files) 2023-11-26 15:56:02,257 INFO [Listener at localhost/43645] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-26 15:56:02,257 INFO [Listener at localhost/43645] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-26 15:56:02,257 INFO [Listener at localhost/43645] regionserver.HRegion(2259): Starting compaction of e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2 in testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:56:02,257 INFO [Listener at localhost/43645] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/afd4a76c27db4d97983ea03d12755441, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/831335e7ccf04e2fa9f49df4e296e0ce, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/e59d3d31316c4d5c82b0fc519efebc15, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/16908d83faec4bb9a04ded4ec4bc19b1, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/11c7e81dae6a4614a173224aab3a25c4] into tmpdir=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp, totalSize=25.4 K 2023-11-26 15:56:02,258 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting afd4a76c27db4d97983ea03d12755441, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701014149878 2023-11-26 15:56:02,258 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 831335e7ccf04e2fa9f49df4e296e0ce, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701014151745 2023-11-26 15:56:02,259 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting e59d3d31316c4d5c82b0fc519efebc15, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701014153602 2023-11-26 15:56:02,259 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 16908d83faec4bb9a04ded4ec4bc19b1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701014155117 2023-11-26 15:56:02,259 DEBUG [Listener at localhost/43645] compactions.Compactor(207): Compacting 11c7e81dae6a4614a173224aab3a25c4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-26 15:56:02,268 INFO [Listener at localhost/43645] throttle.PressureAwareThroughputController(145): e7ba85103d9b5b3dd1d2b42cea0bd1fa#family2#compaction#203 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-26 15:56:02,273 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231126fca865d18b3546ffa358778a99414f34_del 2023-11-26 15:56:02,273 INFO [Listener at localhost/43645] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231126fca865d18b3546ffa358778a99414f34_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231126fca865d18b3546ffa358778a99414f34_del 2023-11-26 15:56:02,346 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/b84bb4720f334fc29200b602b514e541, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/3155ada53f654176bb40a06ac9b17436, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/e991037b3b19499493bdda907a807e31, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/32545d9a99684edbbb2457a8a5b1c43f, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/f5eab8b318364af1bbd80ed5598c54fe] to archive 2023-11-26 15:56:02,347 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:56:02,348 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/b84bb4720f334fc29200b602b514e541 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/b84bb4720f334fc29200b602b514e541 2023-11-26 15:56:02,349 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/3155ada53f654176bb40a06ac9b17436 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/3155ada53f654176bb40a06ac9b17436 2023-11-26 15:56:02,350 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/e991037b3b19499493bdda907a807e31 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/e991037b3b19499493bdda907a807e31 2023-11-26 15:56:02,351 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/32545d9a99684edbbb2457a8a5b1c43f to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/32545d9a99684edbbb2457a8a5b1c43f 2023-11-26 15:56:02,352 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/f5eab8b318364af1bbd80ed5598c54fe to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/f5eab8b318364af1bbd80ed5598c54fe 2023-11-26 15:56:03,092 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5f04a67d9b2e40e8b33f6e2c804bb99c 2023-11-26 15:56:03,093 DEBUG [Listener at localhost/43645] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/.tmp/family2/5f04a67d9b2e40e8b33f6e2c804bb99c as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/5f04a67d9b2e40e8b33f6e2c804bb99c 2023-11-26 15:56:03,099 INFO [Listener at localhost/43645] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5f04a67d9b2e40e8b33f6e2c804bb99c 2023-11-26 15:56:03,100 INFO [Listener at localhost/43645] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2 of e7ba85103d9b5b3dd1d2b42cea0bd1fa into 5f04a67d9b2e40e8b33f6e2c804bb99c(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-26 15:56:03,100 DEBUG [Listener at localhost/43645] regionserver.HRegion(2289): Compaction status journal for e7ba85103d9b5b3dd1d2b42cea0bd1fa: 2023-11-26 15:56:03,105 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:56:03,110 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:56:03,120 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:56:03,122 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:56:03,129 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33415] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xC9\x18X\xF63\xB2^\x94\xA7\x94\xB0\xD2@\x1F\xD5\xC5"\x10t\xFD-\xA7\xA2^\xC83\xD5A\x9AAQ\x8D\x1Cg*\x10J/M\x99`\x94vo\x1D\x99D3\xBB\x05O\xD32\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-11-26 15:56:03,147 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/afd4a76c27db4d97983ea03d12755441, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/831335e7ccf04e2fa9f49df4e296e0ce, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/e59d3d31316c4d5c82b0fc519efebc15, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/16908d83faec4bb9a04ded4ec4bc19b1, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/11c7e81dae6a4614a173224aab3a25c4] to archive 2023-11-26 15:56:03,148 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:56:03,152 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/afd4a76c27db4d97983ea03d12755441 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/afd4a76c27db4d97983ea03d12755441 2023-11-26 15:56:03,154 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/831335e7ccf04e2fa9f49df4e296e0ce to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/831335e7ccf04e2fa9f49df4e296e0ce 2023-11-26 15:56:03,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/e59d3d31316c4d5c82b0fc519efebc15 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/e59d3d31316c4d5c82b0fc519efebc15 2023-11-26 15:56:03,162 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/16908d83faec4bb9a04ded4ec4bc19b1 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/16908d83faec4bb9a04ded4ec4bc19b1 2023-11-26 15:56:03,162 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-26 15:56:03,163 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-26 15:56:03,164 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701014763164 2023-11-26 15:56:03,165 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:56:03,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/11c7e81dae6a4614a173224aab3a25c4 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family2/11c7e81dae6a4614a173224aab3a25c4 2023-11-26 15:56:03,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-26 15:56:03,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-11-26 15:56:03,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023112650c5fe98b8624915ae6d6a770f4b4695_del 2023-11-26 15:56:03,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311266997d87d87344203abbe53f743f80393_del 2023-11-26 15:56:03,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023112600a107f868ae4c4c8e4ffc067654c99b_del 2023-11-26 15:56:03,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-26 15:56:03,693 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] zookeeper.ReadOnlyZKClient(139): Connect 0x2138383e to 127.0.0.1:58210 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-26 15:56:03,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c6a1a7c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-26 15:56:03,699 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231126 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-26 15:56:04,305 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231126b9a1ba2972254bf58616bd02dc7848d5 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231126b9a1ba2972254bf58616bd02dc7848d5 2023-11-26 15:56:04,306 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231126 table='testMajorCompactionFromAdmin' column='family1' 2023-11-26 15:56:04,318 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-26 15:56:04,320 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54046, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-26 15:56:04,332 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-26 15:56:04,337 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55144, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-26 15:56:04,377 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231126/family1/cfe51483b4d24cc09d92e4aee37f2239 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-26 15:56:04,378 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231126/family1/cfe51483b4d24cc09d92e4aee37f2239}] 2023-11-26 15:56:04,384 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231126/family1/cfe51483b4d24cc09d92e4aee37f2239 for inclusion in 905d5b9a6c25e80983010d7024fe6dea/family1 2023-11-26 15:56:04,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-26 15:56:04,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-26 15:56:04,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for 905d5b9a6c25e80983010d7024fe6dea: 2023-11-26 15:56:04,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231126/family1/cfe51483b4d24cc09d92e4aee37f2239 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionFromAdmin__n0sokqi6ukhvmf7bs6e1htvbpcijggerf27qudbrfabkg040n9akuip04r58jdvo/family1/cfe51483b4d24cc09d92e4aee37f2239 2023-11-26 15:56:04,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionFromAdmin__n0sokqi6ukhvmf7bs6e1htvbpcijggerf27qudbrfabkg040n9akuip04r58jdvo/family1/cfe51483b4d24cc09d92e4aee37f2239 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/c827e365b135428bac2af739679bdfca_SeqId_28_ 2023-11-26 15:56:04,421 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionFromAdmin__n0sokqi6ukhvmf7bs6e1htvbpcijggerf27qudbrfabkg040n9akuip04r58jdvo/family1/cfe51483b4d24cc09d92e4aee37f2239 into 905d5b9a6c25e80983010d7024fe6dea/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/c827e365b135428bac2af739679bdfca_SeqId_28_ - updating store file list. 2023-11-26 15:56:04,446 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/c827e365b135428bac2af739679bdfca_SeqId_28_ into 905d5b9a6c25e80983010d7024fe6dea/family1 2023-11-26 15:56:04,446 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionFromAdmin__n0sokqi6ukhvmf7bs6e1htvbpcijggerf27qudbrfabkg040n9akuip04r58jdvo/family1/cfe51483b4d24cc09d92e4aee37f2239 into 905d5b9a6c25e80983010d7024fe6dea/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/family1/c827e365b135428bac2af739679bdfca_SeqId_28_) 2023-11-26 15:56:04,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionFromAdmin__n0sokqi6ukhvmf7bs6e1htvbpcijggerf27qudbrfabkg040n9akuip04r58jdvo/family1/cfe51483b4d24cc09d92e4aee37f2239 2023-11-26 15:56:04,448 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231126 table='testMajorCompactionFromAdmin' column='family1' 2023-11-26 15:56:04,449 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:56:04,451 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231126116d600ed5b8440a8b458678fd8dde30 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231126116d600ed5b8440a8b458678fd8dde30 2023-11-26 15:56:04,452 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311263e940b96953f403eae40c74c860a1d13 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311263e940b96953f403eae40c74c860a1d13 2023-11-26 15:56:04,453 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231126b1a2bce9c3a54968a0a29828e6d28517 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231126b1a2bce9c3a54968a0a29828e6d28517 2023-11-26 15:56:04,454 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231126dccad8bc75b242ac8c098522e218b549 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231126dccad8bc75b242ac8c098522e218b549 2023-11-26 15:56:04,454 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-26 15:56:04,454 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231126' 2023-11-26 15:56:04,455 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231126 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-26 15:56:04,455 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231126 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-26 15:56:05,068 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231126a1f2013f32984826925371c9c336e8f3 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231126a1f2013f32984826925371c9c336e8f3 2023-11-26 15:56:05,069 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231126 table='testMajorCompactionFromAdmin' column='family1' 2023-11-26 15:56:05,115 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231126/family1/1b25cd5667f441879aa2bdb4a0754bc0 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-26 15:56:05,116 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231126/family1/1b25cd5667f441879aa2bdb4a0754bc0}] 2023-11-26 15:56:05,118 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231126/family1/1b25cd5667f441879aa2bdb4a0754bc0 for inclusion in 2b5c98810f62b16839301eb6de0d4e23/family1 2023-11-26 15:56:05,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-26 15:56:05,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-26 15:56:05,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for 2b5c98810f62b16839301eb6de0d4e23: 2023-11-26 15:56:05,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231126/family1/1b25cd5667f441879aa2bdb4a0754bc0 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionFromAdmin__hlpsrvbsch0qriadadg96hvv6l7su7ccmoeupv8n8ig4ot8nhk38qthuc5ithpj/family1/1b25cd5667f441879aa2bdb4a0754bc0 2023-11-26 15:56:05,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionFromAdmin__hlpsrvbsch0qriadadg96hvv6l7su7ccmoeupv8n8ig4ot8nhk38qthuc5ithpj/family1/1b25cd5667f441879aa2bdb4a0754bc0 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/d3bdc736e656425eaf6b6b737105e1dd_SeqId_28_ 2023-11-26 15:56:05,144 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionFromAdmin__hlpsrvbsch0qriadadg96hvv6l7su7ccmoeupv8n8ig4ot8nhk38qthuc5ithpj/family1/1b25cd5667f441879aa2bdb4a0754bc0 into 2b5c98810f62b16839301eb6de0d4e23/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/d3bdc736e656425eaf6b6b737105e1dd_SeqId_28_ - updating store file list. 2023-11-26 15:56:05,166 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/d3bdc736e656425eaf6b6b737105e1dd_SeqId_28_ into 2b5c98810f62b16839301eb6de0d4e23/family1 2023-11-26 15:56:05,166 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionFromAdmin__hlpsrvbsch0qriadadg96hvv6l7su7ccmoeupv8n8ig4ot8nhk38qthuc5ithpj/family1/1b25cd5667f441879aa2bdb4a0754bc0 into 2b5c98810f62b16839301eb6de0d4e23/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/family1/d3bdc736e656425eaf6b6b737105e1dd_SeqId_28_) 2023-11-26 15:56:05,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionFromAdmin__hlpsrvbsch0qriadadg96hvv6l7su7ccmoeupv8n8ig4ot8nhk38qthuc5ithpj/family1/1b25cd5667f441879aa2bdb4a0754bc0 2023-11-26 15:56:05,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231126 table='testMajorCompactionFromAdmin' column='family1' 2023-11-26 15:56:05,168 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:56:05,169 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311261ab236c21e7e4deda805a633cdc9b248 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311261ab236c21e7e4deda805a633cdc9b248 2023-11-26 15:56:05,170 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231126341f26da5f45458a8d36aeb49d6f9a14 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231126341f26da5f45458a8d36aeb49d6f9a14 2023-11-26 15:56:05,171 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311263577a2a421a144d294d84f0325b29126 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311263577a2a421a144d294d84f0325b29126 2023-11-26 15:56:05,172 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231126809b8fbbc2f34441900d049ed4d41724 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231126809b8fbbc2f34441900d049ed4d41724 2023-11-26 15:56:05,172 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-26 15:56:05,172 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231126' 2023-11-26 15:56:05,173 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231126 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-26 15:56:05,173 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231126 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-26 15:56:06,132 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231126d1ac9d3c46e546fda79116aff3fb9213 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231126d1ac9d3c46e546fda79116aff3fb9213 2023-11-26 15:56:06,133 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231126 table='testMajorCompactionFromAdmin' column='family1' 2023-11-26 15:56:06,173 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231126/family1/eaf4d81a96e0420187b74561ebb3581e first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-26 15:56:06,174 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa., hostname=jenkins-hbase4.apache.org,41861,1701014000937, seqNum=2 for row with hfile group [{family1,hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231126/family1/eaf4d81a96e0420187b74561ebb3581e}] 2023-11-26 15:56:06,176 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(763): Validating hfile at hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231126/family1/eaf4d81a96e0420187b74561ebb3581e for inclusion in e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1 2023-11-26 15:56:06,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-26 15:56:06,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(777): Region bounds: first= last=1 2023-11-26 15:56:06,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegion(2446): Flush status journal for e7ba85103d9b5b3dd1d2b42cea0bd1fa: 2023-11-26 15:56:06,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231126/family1/eaf4d81a96e0420187b74561ebb3581e to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionFromAdmin__4qa1dl99mlt6d8cjsk0s074v7jp1smk0lo15oh6fhfogflcfn00k48s9s60ton63/family1/eaf4d81a96e0420187b74561ebb3581e 2023-11-26 15:56:06,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionFromAdmin__4qa1dl99mlt6d8cjsk0s074v7jp1smk0lo15oh6fhfogflcfn00k48s9s60ton63/family1/eaf4d81a96e0420187b74561ebb3581e as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/aab3cd26930345c9beda9bbca2b26390_SeqId_28_ 2023-11-26 15:56:06,202 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(849): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionFromAdmin__4qa1dl99mlt6d8cjsk0s074v7jp1smk0lo15oh6fhfogflcfn00k48s9s60ton63/family1/eaf4d81a96e0420187b74561ebb3581e into e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/aab3cd26930345c9beda9bbca2b26390_SeqId_28_ - updating store file list. 2023-11-26 15:56:06,235 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(882): Loaded HFile hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/aab3cd26930345c9beda9bbca2b26390_SeqId_28_ into e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1 2023-11-26 15:56:06,235 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.HStore(855): Successfully loaded hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionFromAdmin__4qa1dl99mlt6d8cjsk0s074v7jp1smk0lo15oh6fhfogflcfn00k48s9s60ton63/family1/eaf4d81a96e0420187b74561ebb3581e into e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1 (new location: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/family1/aab3cd26930345c9beda9bbca2b26390_SeqId_28_) 2023-11-26 15:56:06,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=41861] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/staging/jenkins__testMajorCompactionFromAdmin__4qa1dl99mlt6d8cjsk0s074v7jp1smk0lo15oh6fhfogflcfn00k48s9s60ton63/family1/eaf4d81a96e0420187b74561ebb3581e 2023-11-26 15:56:06,237 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231126 table='testMajorCompactionFromAdmin' column='family1' 2023-11-26 15:56:06,238 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:56:06,239 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311260795fbc8bb0c4bca94888373685630ef to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311260795fbc8bb0c4bca94888373685630ef 2023-11-26 15:56:06,240 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311262a5ed192eb6649f48197953fadcf17da to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311262a5ed192eb6649f48197953fadcf17da 2023-11-26 15:56:06,241 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231126d78ab93dc1814768b84490e3e09a8c76 to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231126d78ab93dc1814768b84490e3e09a8c76 2023-11-26 15:56:06,242 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231126e518a6fd116645a985252f015ae56e3b to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231126e518a6fd116645a985252f015ae56e3b 2023-11-26 15:56:06,242 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-26 15:56:06,242 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231126' 2023-11-26 15:56:06,243 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231126 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-26 15:56:06,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-26 15:56:06,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-26 15:56:06,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023112650c5fe98b8624915ae6d6a770f4b4695_del] 2023-11-26 15:56:06,243 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:56:06,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023112650c5fe98b8624915ae6d6a770f4b4695_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023112650c5fe98b8624915ae6d6a770f4b4695_del 2023-11-26 15:56:06,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-26 15:56:06,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311266997d87d87344203abbe53f743f80393_del] 2023-11-26 15:56:06,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:56:06,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311266997d87d87344203abbe53f743f80393_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311266997d87d87344203abbe53f743f80393_del 2023-11-26 15:56:06,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-26 15:56:06,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] compactions.PartitionedMobCompactor(367): [hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023112600a107f868ae4c4c8e4ffc067654c99b_del] 2023-11-26 15:56:06,247 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] backup.HFileArchiver(360): Archiving compacted files. 2023-11-26 15:56:06,248 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023112600a107f868ae4c4c8e4ffc067654c99b_del to hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023112600a107f868ae4c4c8e4ffc067654c99b_del 2023-11-26 15:56:06,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-26 15:56:06,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701014003802] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-26 15:56:06,250 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-26 15:56:06,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.0880 sec 2023-11-26 15:56:06,270 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:56:06,273 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:56:06,277 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-26 15:56:06,278 DEBUG [Listener at localhost/43645] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-26 15:56:06,284 INFO [Listener at localhost/43645] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-26 15:56:06,336 INFO [Listener at localhost/43645] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=251 (was 260), OpenFileDescriptor=671 (was 675), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=258 (was 214) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=7515 (was 8213) 2023-11-26 15:56:06,338 DEBUG [Listener at localhost/43645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7faa020d to 127.0.0.1:58210 2023-11-26 15:56:06,338 DEBUG [Listener at localhost/43645] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:56:06,338 INFO [Listener at localhost/43645] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-11-26 15:56:06,339 INFO [Listener at localhost/43645] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-26 15:56:06,339 DEBUG [Listener at localhost/43645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b2a962e to 127.0.0.1:58210 2023-11-26 15:56:06,339 DEBUG [Listener at localhost/43645] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:56:06,340 DEBUG [Listener at localhost/43645] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-11-26 15:56:06,340 DEBUG [Listener at localhost/43645] util.JVMClusterUtil(257): Found active master hash=1074978649, stopped=false 2023-11-26 15:56:06,340 INFO [Listener at localhost/43645] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33415,1701013999777 2023-11-26 15:56:06,343 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-26 15:56:06,343 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-26 15:56:06,343 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-26 15:56:06,343 INFO [Listener at localhost/43645] procedure2.ProcedureExecutor(628): Stopping 2023-11-26 15:56:06,343 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-26 15:56:06,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-26 15:56:06,344 DEBUG [Listener at localhost/43645] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75291fd7 to 127.0.0.1:58210 2023-11-26 15:56:06,344 DEBUG [Listener at localhost/43645] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:56:06,345 INFO [Listener at localhost/43645] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,41861,1701014000937' ***** 2023-11-26 15:56:06,345 INFO [Listener at localhost/43645] regionserver.HRegionServer(2314): STOPPED: Shutdown requested 2023-11-26 15:56:06,345 INFO [RS:0;jenkins-hbase4:41861] regionserver.HeapMemoryManager(220): Stopping 2023-11-26 15:56:06,345 INFO [RS:0;jenkins-hbase4:41861] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-11-26 15:56:06,345 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-11-26 15:56:06,345 INFO [RS:0;jenkins-hbase4:41861] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-11-26 15:56:06,346 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for 26d86fc5d3975b9de436cf03709f95f3 2023-11-26 15:56:06,347 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for dd287aba04977d5f4b3a261b02c79746 2023-11-26 15:56:06,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 26d86fc5d3975b9de436cf03709f95f3, disabling compactions & flushes 2023-11-26 15:56:06,347 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for f129063d34c7e932fc424e95e294be7a 2023-11-26 15:56:06,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:56:06,347 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for 905abcb77b8ecc225b5ac5b6464c5c8a 2023-11-26 15:56:06,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:56:06,347 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for 88c67e38620ab4e718a57f53e9db97ae 2023-11-26 15:56:06,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. after waiting 0 ms 2023-11-26 15:56:06,347 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:56:06,347 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:56:06,347 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for 7b89b16a24fd848ba52ba52ed226f03a 2023-11-26 15:56:06,347 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for 75e619b545bc7cbd3a56d0999f629da2 2023-11-26 15:56:06,347 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for 8929c83bb706f599f3d8e0a34ab792c9 2023-11-26 15:56:06,347 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for 93605f22caa460b5319b75b058b5fadd 2023-11-26 15:56:06,347 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for c441d3c84d384c985b934cd76f2ad1fc 2023-11-26 15:56:06,347 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for 900c2d000cb588ea26813112d428c4a6 2023-11-26 15:56:06,347 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for e0acbef3eb947d2e75284917359a9855 2023-11-26 15:56:06,347 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for 2b5c98810f62b16839301eb6de0d4e23 2023-11-26 15:56:06,347 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for 905d5b9a6c25e80983010d7024fe6dea 2023-11-26 15:56:06,347 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for 4cfb0cd6c51e1e07ae54d6cd68e75931 2023-11-26 15:56:06,347 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for 8f44376928d5389e178e37d6e9572233 2023-11-26 15:56:06,347 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for 1cc117e24a014df5815461dcd6bc9ce1 2023-11-26 15:56:06,347 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for c250ec54ecf7a7b68d0c6e162cb264fe 2023-11-26 15:56:06,347 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for e7ba85103d9b5b3dd1d2b42cea0bd1fa 2023-11-26 15:56:06,347 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:56:06,347 DEBUG [RS:0;jenkins-hbase4:41861] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64765258 to 127.0.0.1:58210 2023-11-26 15:56:06,347 DEBUG [RS:0;jenkins-hbase4:41861] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:56:06,357 INFO [RS:0;jenkins-hbase4:41861] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-11-26 15:56:06,357 INFO [RS:0;jenkins-hbase4:41861] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-11-26 15:56:06,357 INFO [RS:0;jenkins-hbase4:41861] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-11-26 15:56:06,357 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(3308): Received CLOSE for 1588230740 2023-11-26 15:56:06,360 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(1477): Waiting on 21 regions to close 2023-11-26 15:56:06,360 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-26 15:56:06,360 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-26 15:56:06,360 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-26 15:56:06,360 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-26 15:56:06,360 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-26 15:56:06,361 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-11-26 15:56:06,361 DEBUG [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(1507): Waiting on 1588230740, 1cc117e24a014df5815461dcd6bc9ce1, 26d86fc5d3975b9de436cf03709f95f3, 2b5c98810f62b16839301eb6de0d4e23, 4cfb0cd6c51e1e07ae54d6cd68e75931, 75e619b545bc7cbd3a56d0999f629da2, 7b89b16a24fd848ba52ba52ed226f03a, 88c67e38620ab4e718a57f53e9db97ae, 8929c83bb706f599f3d8e0a34ab792c9, 8f44376928d5389e178e37d6e9572233, 900c2d000cb588ea26813112d428c4a6, 905abcb77b8ecc225b5ac5b6464c5c8a, 905d5b9a6c25e80983010d7024fe6dea, 93605f22caa460b5319b75b058b5fadd, c250ec54ecf7a7b68d0c6e162cb264fe, c441d3c84d384c985b934cd76f2ad1fc, dd287aba04977d5f4b3a261b02c79746, e0acbef3eb947d2e75284917359a9855, e7ba85103d9b5b3dd1d2b42cea0bd1fa, ea3a647b9f914561bb8e56dcb1bd89ac, f129063d34c7e932fc424e95e294be7a 2023-11-26 15:56:06,361 INFO [regionserver/jenkins-hbase4:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-11-26 15:56:06,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/26d86fc5d3975b9de436cf03709f95f3/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-26 15:56:06,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:56:06,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 26d86fc5d3975b9de436cf03709f95f3: 2023-11-26 15:56:06,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1701014119874.26d86fc5d3975b9de436cf03709f95f3. 2023-11-26 15:56:06,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dd287aba04977d5f4b3a261b02c79746, disabling compactions & flushes 2023-11-26 15:56:06,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:56:06,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:56:06,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. after waiting 0 ms 2023-11-26 15:56:06,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:56:06,401 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/.tmp/info/000028c3d67d4757b7734517ef887f6b 2023-11-26 15:56:06,404 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-11-26 15:56:06,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/dd287aba04977d5f4b3a261b02c79746/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-26 15:56:06,409 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:56:06,409 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dd287aba04977d5f4b3a261b02c79746: 2023-11-26 15:56:06,409 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 000028c3d67d4757b7734517ef887f6b 2023-11-26 15:56:06,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1701014095146.dd287aba04977d5f4b3a261b02c79746. 2023-11-26 15:56:06,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f129063d34c7e932fc424e95e294be7a, disabling compactions & flushes 2023-11-26 15:56:06,410 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:56:06,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:56:06,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. after waiting 0 ms 2023-11-26 15:56:06,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:56:06,428 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/.tmp/rep_barrier/02681aaf2b604f38a0b04499ecaa8987 2023-11-26 15:56:06,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithMonthlyPolicy/f129063d34c7e932fc424e95e294be7a/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-26 15:56:06,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:56:06,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f129063d34c7e932fc424e95e294be7a: 2023-11-26 15:56:06,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1701014137846.f129063d34c7e932fc424e95e294be7a. 2023-11-26 15:56:06,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 905abcb77b8ecc225b5ac5b6464c5c8a, disabling compactions & flushes 2023-11-26 15:56:06,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:56:06,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:56:06,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. after waiting 0 ms 2023-11-26 15:56:06,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:56:06,433 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 02681aaf2b604f38a0b04499ecaa8987 2023-11-26 15:56:06,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/905abcb77b8ecc225b5ac5b6464c5c8a/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-26 15:56:06,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:56:06,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 905abcb77b8ecc225b5ac5b6464c5c8a: 2023-11-26 15:56:06,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701014057566.905abcb77b8ecc225b5ac5b6464c5c8a. 2023-11-26 15:56:06,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 88c67e38620ab4e718a57f53e9db97ae, disabling compactions & flushes 2023-11-26 15:56:06,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae. 2023-11-26 15:56:06,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae. 2023-11-26 15:56:06,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae. after waiting 0 ms 2023-11-26 15:56:06,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae. 2023-11-26 15:56:06,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 88c67e38620ab4e718a57f53e9db97ae 1/1 column families, dataSize=109 B heapSize=592 B 2023-11-26 15:56:06,456 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/.tmp/table/ba5f338e97d04f9aaa8e5febd1e44f52 2023-11-26 15:56:06,461 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ba5f338e97d04f9aaa8e5febd1e44f52 2023-11-26 15:56:06,462 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/.tmp/info/000028c3d67d4757b7734517ef887f6b as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/info/000028c3d67d4757b7734517ef887f6b 2023-11-26 15:56:06,470 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 000028c3d67d4757b7734517ef887f6b 2023-11-26 15:56:06,470 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/info/000028c3d67d4757b7734517ef887f6b, entries=226, sequenceid=130, filesize=37.9 K 2023-11-26 15:56:06,471 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/.tmp/rep_barrier/02681aaf2b604f38a0b04499ecaa8987 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/rep_barrier/02681aaf2b604f38a0b04499ecaa8987 2023-11-26 15:56:06,476 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 02681aaf2b604f38a0b04499ecaa8987 2023-11-26 15:56:06,476 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/rep_barrier/02681aaf2b604f38a0b04499ecaa8987, entries=1, sequenceid=130, filesize=5.0 K 2023-11-26 15:56:06,477 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/.tmp/table/ba5f338e97d04f9aaa8e5febd1e44f52 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/table/ba5f338e97d04f9aaa8e5febd1e44f52 2023-11-26 15:56:06,484 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ba5f338e97d04f9aaa8e5febd1e44f52 2023-11-26 15:56:06,485 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/table/ba5f338e97d04f9aaa8e5febd1e44f52, entries=27, sequenceid=130, filesize=6.6 K 2023-11-26 15:56:06,485 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 124ms, sequenceid=130, compaction requested=false 2023-11-26 15:56:06,497 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-11-26 15:56:06,498 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-26 15:56:06,499 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-26 15:56:06,499 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-26 15:56:06,499 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-11-26 15:56:06,561 DEBUG [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(1507): Waiting on 1cc117e24a014df5815461dcd6bc9ce1, 2b5c98810f62b16839301eb6de0d4e23, 4cfb0cd6c51e1e07ae54d6cd68e75931, 75e619b545bc7cbd3a56d0999f629da2, 7b89b16a24fd848ba52ba52ed226f03a, 88c67e38620ab4e718a57f53e9db97ae, 8929c83bb706f599f3d8e0a34ab792c9, 8f44376928d5389e178e37d6e9572233, 900c2d000cb588ea26813112d428c4a6, 905d5b9a6c25e80983010d7024fe6dea, 93605f22caa460b5319b75b058b5fadd, c250ec54ecf7a7b68d0c6e162cb264fe, c441d3c84d384c985b934cd76f2ad1fc, e0acbef3eb947d2e75284917359a9855, e7ba85103d9b5b3dd1d2b42cea0bd1fa, ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:56:06,762 DEBUG [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(1507): Waiting on 1cc117e24a014df5815461dcd6bc9ce1, 2b5c98810f62b16839301eb6de0d4e23, 4cfb0cd6c51e1e07ae54d6cd68e75931, 75e619b545bc7cbd3a56d0999f629da2, 7b89b16a24fd848ba52ba52ed226f03a, 88c67e38620ab4e718a57f53e9db97ae, 8929c83bb706f599f3d8e0a34ab792c9, 8f44376928d5389e178e37d6e9572233, 900c2d000cb588ea26813112d428c4a6, 905d5b9a6c25e80983010d7024fe6dea, 93605f22caa460b5319b75b058b5fadd, c250ec54ecf7a7b68d0c6e162cb264fe, c441d3c84d384c985b934cd76f2ad1fc, e0acbef3eb947d2e75284917359a9855, e7ba85103d9b5b3dd1d2b42cea0bd1fa, ea3a647b9f914561bb8e56dcb1bd89ac 2023-11-26 15:56:06,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/namespace/88c67e38620ab4e718a57f53e9db97ae/.tmp/info/48614600648d49fb9c34c7962f85068b 2023-11-26 15:56:06,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/namespace/88c67e38620ab4e718a57f53e9db97ae/.tmp/info/48614600648d49fb9c34c7962f85068b as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/namespace/88c67e38620ab4e718a57f53e9db97ae/info/48614600648d49fb9c34c7962f85068b 2023-11-26 15:56:06,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/namespace/88c67e38620ab4e718a57f53e9db97ae/info/48614600648d49fb9c34c7962f85068b, entries=3, sequenceid=7, filesize=4.8 K 2023-11-26 15:56:06,873 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 88c67e38620ab4e718a57f53e9db97ae in 435ms, sequenceid=7, compaction requested=false 2023-11-26 15:56:06,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/hbase/namespace/88c67e38620ab4e718a57f53e9db97ae/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-11-26 15:56:06,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae. 2023-11-26 15:56:06,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 88c67e38620ab4e718a57f53e9db97ae: 2023-11-26 15:56:06,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1701014002770.88c67e38620ab4e718a57f53e9db97ae. 2023-11-26 15:56:06,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ea3a647b9f914561bb8e56dcb1bd89ac, disabling compactions & flushes 2023-11-26 15:56:06,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:56:06,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:56:06,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. after waiting 0 ms 2023-11-26 15:56:06,877 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:56:06,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ea3a647b9f914561bb8e56dcb1bd89ac/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-26 15:56:06,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:56:06,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ea3a647b9f914561bb8e56dcb1bd89ac: 2023-11-26 15:56:06,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701014073862.ea3a647b9f914561bb8e56dcb1bd89ac. 2023-11-26 15:56:06,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7b89b16a24fd848ba52ba52ed226f03a, disabling compactions & flushes 2023-11-26 15:56:06,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:56:06,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:56:06,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. after waiting 0 ms 2023-11-26 15:56:06,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:56:06,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/7b89b16a24fd848ba52ba52ed226f03a/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-26 15:56:06,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:56:06,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7b89b16a24fd848ba52ba52ed226f03a: 2023-11-26 15:56:06,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1701014119874.7b89b16a24fd848ba52ba52ed226f03a. 2023-11-26 15:56:06,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 75e619b545bc7cbd3a56d0999f629da2, disabling compactions & flushes 2023-11-26 15:56:06,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2. 2023-11-26 15:56:06,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2. 2023-11-26 15:56:06,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2. after waiting 0 ms 2023-11-26 15:56:06,885 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2. 2023-11-26 15:56:06,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/75e619b545bc7cbd3a56d0999f629da2/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-26 15:56:06,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2. 2023-11-26 15:56:06,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 75e619b545bc7cbd3a56d0999f629da2: 2023-11-26 15:56:06,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1701014040798.75e619b545bc7cbd3a56d0999f629da2. 2023-11-26 15:56:06,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8929c83bb706f599f3d8e0a34ab792c9, disabling compactions & flushes 2023-11-26 15:56:06,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:56:06,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:56:06,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. after waiting 0 ms 2023-11-26 15:56:06,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:56:06,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithMonthlyPolicy/8929c83bb706f599f3d8e0a34ab792c9/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-26 15:56:06,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:56:06,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8929c83bb706f599f3d8e0a34ab792c9: 2023-11-26 15:56:06,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1701014016092.8929c83bb706f599f3d8e0a34ab792c9. 2023-11-26 15:56:06,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 93605f22caa460b5319b75b058b5fadd, disabling compactions & flushes 2023-11-26 15:56:06,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:56:06,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:56:06,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. after waiting 0 ms 2023-11-26 15:56:06,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:56:06,894 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMinorCompactionWithWeeklyPolicy/93605f22caa460b5319b75b058b5fadd/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-26 15:56:06,895 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:56:06,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 93605f22caa460b5319b75b058b5fadd: 2023-11-26 15:56:06,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1701014028632.93605f22caa460b5319b75b058b5fadd. 2023-11-26 15:56:06,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c441d3c84d384c985b934cd76f2ad1fc, disabling compactions & flushes 2023-11-26 15:56:06,895 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc. 2023-11-26 15:56:06,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc. 2023-11-26 15:56:06,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc. after waiting 0 ms 2023-11-26 15:56:06,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc. 2023-11-26 15:56:06,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/c441d3c84d384c985b934cd76f2ad1fc/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-26 15:56:06,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc. 2023-11-26 15:56:06,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c441d3c84d384c985b934cd76f2ad1fc: 2023-11-26 15:56:06,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1701014040798.c441d3c84d384c985b934cd76f2ad1fc. 2023-11-26 15:56:06,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 900c2d000cb588ea26813112d428c4a6, disabling compactions & flushes 2023-11-26 15:56:06,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:56:06,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:56:06,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. after waiting 0 ms 2023-11-26 15:56:06,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:56:06,901 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/900c2d000cb588ea26813112d428c4a6/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-26 15:56:06,902 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:56:06,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 900c2d000cb588ea26813112d428c4a6: 2023-11-26 15:56:06,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1701014095146.900c2d000cb588ea26813112d428c4a6. 2023-11-26 15:56:06,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e0acbef3eb947d2e75284917359a9855, disabling compactions & flushes 2023-11-26 15:56:06,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:56:06,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:56:06,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. after waiting 0 ms 2023-11-26 15:56:06,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:56:06,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/ns/testMinorCompaction/e0acbef3eb947d2e75284917359a9855/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-26 15:56:06,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:56:06,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e0acbef3eb947d2e75284917359a9855: 2023-11-26 15:56:06,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1701014119874.e0acbef3eb947d2e75284917359a9855. 2023-11-26 15:56:06,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2b5c98810f62b16839301eb6de0d4e23, disabling compactions & flushes 2023-11-26 15:56:06,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:56:06,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:56:06,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. after waiting 0 ms 2023-11-26 15:56:06,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:56:06,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/2b5c98810f62b16839301eb6de0d4e23/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-26 15:56:06,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:56:06,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2b5c98810f62b16839301eb6de0d4e23: 2023-11-26 15:56:06,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1701014148734.2b5c98810f62b16839301eb6de0d4e23. 2023-11-26 15:56:06,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 905d5b9a6c25e80983010d7024fe6dea, disabling compactions & flushes 2023-11-26 15:56:06,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:56:06,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:56:06,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. after waiting 0 ms 2023-11-26 15:56:06,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:56:06,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/905d5b9a6c25e80983010d7024fe6dea/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-26 15:56:06,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:56:06,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 905d5b9a6c25e80983010d7024fe6dea: 2023-11-26 15:56:06,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1701014148734.905d5b9a6c25e80983010d7024fe6dea. 2023-11-26 15:56:06,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4cfb0cd6c51e1e07ae54d6cd68e75931, disabling compactions & flushes 2023-11-26 15:56:06,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:56:06,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:56:06,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. after waiting 0 ms 2023-11-26 15:56:06,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:56:06,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyPolicy/4cfb0cd6c51e1e07ae54d6cd68e75931/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-26 15:56:06,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:56:06,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4cfb0cd6c51e1e07ae54d6cd68e75931: 2023-11-26 15:56:06,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1701014045015.4cfb0cd6c51e1e07ae54d6cd68e75931. 2023-11-26 15:56:06,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8f44376928d5389e178e37d6e9572233, disabling compactions & flushes 2023-11-26 15:56:06,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. 2023-11-26 15:56:06,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. 2023-11-26 15:56:06,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. after waiting 0 ms 2023-11-26 15:56:06,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. 2023-11-26 15:56:06,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testScannerOnBulkLoadRefHFiles/8f44376928d5389e178e37d6e9572233/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-26 15:56:06,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. 2023-11-26 15:56:06,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8f44376928d5389e178e37d6e9572233: 2023-11-26 15:56:06,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1701014040798.8f44376928d5389e178e37d6e9572233. 2023-11-26 15:56:06,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1cc117e24a014df5815461dcd6bc9ce1, disabling compactions & flushes 2023-11-26 15:56:06,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:56:06,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:56:06,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. after waiting 0 ms 2023-11-26 15:56:06,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:56:06,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testCompactionWithHFileLink/1cc117e24a014df5815461dcd6bc9ce1/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-26 15:56:06,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:56:06,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1cc117e24a014df5815461dcd6bc9ce1: 2023-11-26 15:56:06,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1701014095146.1cc117e24a014df5815461dcd6bc9ce1. 2023-11-26 15:56:06,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c250ec54ecf7a7b68d0c6e162cb264fe, disabling compactions & flushes 2023-11-26 15:56:06,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:56:06,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:56:06,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. after waiting 0 ms 2023-11-26 15:56:06,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:56:06,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/c250ec54ecf7a7b68d0c6e162cb264fe/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-26 15:56:06,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:56:06,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c250ec54ecf7a7b68d0c6e162cb264fe: 2023-11-26 15:56:06,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1701014004013.c250ec54ecf7a7b68d0c6e162cb264fe. 2023-11-26 15:56:06,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e7ba85103d9b5b3dd1d2b42cea0bd1fa, disabling compactions & flushes 2023-11-26 15:56:06,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:56:06,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:56:06,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. after waiting 0 ms 2023-11-26 15:56:06,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:56:06,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/data/default/testMajorCompactionFromAdmin/e7ba85103d9b5b3dd1d2b42cea0bd1fa/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-26 15:56:06,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:56:06,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e7ba85103d9b5b3dd1d2b42cea0bd1fa: 2023-11-26 15:56:06,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1701014148734.e7ba85103d9b5b3dd1d2b42cea0bd1fa. 2023-11-26 15:56:06,962 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,41861,1701014000937; all regions closed. 2023-11-26 15:56:06,969 DEBUG [RS:0;jenkins-hbase4:41861] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/oldWALs 2023-11-26 15:56:06,969 INFO [RS:0;jenkins-hbase4:41861] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41861%2C1701014000937.meta:.meta(num 1701014002523) 2023-11-26 15:56:06,973 DEBUG [RS:0;jenkins-hbase4:41861] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/oldWALs 2023-11-26 15:56:06,973 INFO [RS:0;jenkins-hbase4:41861] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41861%2C1701014000937:(num 1701014002379) 2023-11-26 15:56:06,973 DEBUG [RS:0;jenkins-hbase4:41861] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:56:06,973 INFO [RS:0;jenkins-hbase4:41861] regionserver.LeaseManager(133): Closed leases 2023-11-26 15:56:06,973 INFO [RS:0;jenkins-hbase4:41861] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-11-26 15:56:06,973 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-26 15:56:06,974 INFO [RS:0;jenkins-hbase4:41861] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41861 2023-11-26 15:56:06,982 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-26 15:56:06,982 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41861,1701014000937 2023-11-26 15:56:06,982 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-26 15:56:06,983 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41861,1701014000937] 2023-11-26 15:56:06,983 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41861,1701014000937; numProcessing=1 2023-11-26 15:56:06,984 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41861,1701014000937 already deleted, retry=false 2023-11-26 15:56:06,984 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,41861,1701014000937 expired; onlineServers=0 2023-11-26 15:56:06,984 INFO [RegionServerTracker-0] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,33415,1701013999777' ***** 2023-11-26 15:56:06,984 INFO [RegionServerTracker-0] regionserver.HRegionServer(2314): STOPPED: Cluster shutdown set; onlineServer=0 2023-11-26 15:56:06,985 DEBUG [M:0;jenkins-hbase4:33415] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12fd562, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-26 15:56:06,985 INFO [M:0;jenkins-hbase4:33415] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,33415,1701013999777 2023-11-26 15:56:06,985 INFO [M:0;jenkins-hbase4:33415] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,33415,1701013999777; all regions closed. 2023-11-26 15:56:06,985 DEBUG [M:0;jenkins-hbase4:33415] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-26 15:56:06,985 DEBUG [M:0;jenkins-hbase4:33415] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-11-26 15:56:06,985 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-11-26 15:56:06,985 DEBUG [M:0;jenkins-hbase4:33415] cleaner.HFileCleaner(317): Stopping file delete threads 2023-11-26 15:56:06,985 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1701014002045] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1701014002045,5,FailOnTimeoutGroup] 2023-11-26 15:56:06,985 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1701014002043] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1701014002043,5,FailOnTimeoutGroup] 2023-11-26 15:56:06,985 INFO [M:0;jenkins-hbase4:33415] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-11-26 15:56:06,985 INFO [M:0;jenkins-hbase4:33415] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-11-26 15:56:06,986 INFO [M:0;jenkins-hbase4:33415] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-11-26 15:56:06,986 DEBUG [M:0;jenkins-hbase4:33415] master.HMaster(1512): Stopping service threads 2023-11-26 15:56:06,986 INFO [M:0;jenkins-hbase4:33415] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-11-26 15:56:06,986 ERROR [M:0;jenkins-hbase4:33415] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-19,5,PEWorkerGroup] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-11-26 15:56:06,987 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-11-26 15:56:06,987 INFO [M:0;jenkins-hbase4:33415] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-11-26 15:56:06,987 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-26 15:56:06,987 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-11-26 15:56:06,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-26 15:56:06,987 DEBUG [M:0;jenkins-hbase4:33415] zookeeper.ZKUtil(399): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-11-26 15:56:06,987 WARN [M:0;jenkins-hbase4:33415] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-11-26 15:56:06,987 INFO [M:0;jenkins-hbase4:33415] assignment.AssignmentManager(315): Stopping assignment manager 2023-11-26 15:56:06,988 INFO [M:0;jenkins-hbase4:33415] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-11-26 15:56:06,988 DEBUG [M:0;jenkins-hbase4:33415] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-26 15:56:06,988 INFO [M:0;jenkins-hbase4:33415] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-26 15:56:06,988 DEBUG [M:0;jenkins-hbase4:33415] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-26 15:56:06,988 DEBUG [M:0;jenkins-hbase4:33415] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-26 15:56:06,988 DEBUG [M:0;jenkins-hbase4:33415] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-26 15:56:06,988 INFO [M:0;jenkins-hbase4:33415] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.65 KB heapSize=598.77 KB 2023-11-26 15:56:07,084 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-26 15:56:07,084 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): regionserver:41861-0x1002a65b15c0001, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-26 15:56:07,084 INFO [RS:0;jenkins-hbase4:41861] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,41861,1701014000937; zookeeper connection closed. 2023-11-26 15:56:07,084 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@329c2495] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@329c2495 2023-11-26 15:56:07,084 INFO [Listener at localhost/43645] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-11-26 15:56:07,404 INFO [M:0;jenkins-hbase4:33415] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.65 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fc8a77bda7d54d24935218784f59bdc6 2023-11-26 15:56:07,408 INFO [M:0;jenkins-hbase4:33415] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fc8a77bda7d54d24935218784f59bdc6 2023-11-26 15:56:07,409 DEBUG [M:0;jenkins-hbase4:33415] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/fc8a77bda7d54d24935218784f59bdc6 as hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fc8a77bda7d54d24935218784f59bdc6 2023-11-26 15:56:07,413 INFO [M:0;jenkins-hbase4:33415] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fc8a77bda7d54d24935218784f59bdc6 2023-11-26 15:56:07,413 INFO [M:0;jenkins-hbase4:33415] regionserver.HStore(1080): Added hdfs://localhost:41123/user/jenkins/test-data/dfeece7b-6398-a39b-41ae-ee8cfa20c88b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/fc8a77bda7d54d24935218784f59bdc6, entries=123, sequenceid=1011, filesize=33.3 K 2023-11-26 15:56:07,414 INFO [M:0;jenkins-hbase4:33415] regionserver.HRegion(2948): Finished flush of dataSize ~512.65 KB/524953, heapSize ~598.75 KB/613120, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 426ms, sequenceid=1011, compaction requested=false 2023-11-26 15:56:07,414 INFO [M:0;jenkins-hbase4:33415] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-26 15:56:07,414 DEBUG [M:0;jenkins-hbase4:33415] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-26 15:56:07,417 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-26 15:56:07,417 INFO [M:0;jenkins-hbase4:33415] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-11-26 15:56:07,417 INFO [M:0;jenkins-hbase4:33415] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33415 2023-11-26 15:56:07,420 DEBUG [M:0;jenkins-hbase4:33415] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33415,1701013999777 already deleted, retry=false 2023-11-26 15:56:07,522 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-26 15:56:07,522 INFO [M:0;jenkins-hbase4:33415] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,33415,1701013999777; zookeeper connection closed. 2023-11-26 15:56:07,522 DEBUG [Listener at localhost/43645-EventThread] zookeeper.ZKWatcher(600): master:33415-0x1002a65b15c0000, quorum=127.0.0.1:58210, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-26 15:56:07,523 WARN [Listener at localhost/43645] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-11-26 15:56:07,527 INFO [Listener at localhost/43645] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-26 15:56:07,634 WARN [BP-728291432-172.31.14.131-1701013996280 heartbeating to localhost/127.0.0.1:41123] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-11-26 15:56:07,634 WARN [BP-728291432-172.31.14.131-1701013996280 heartbeating to localhost/127.0.0.1:41123] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-728291432-172.31.14.131-1701013996280 (Datanode Uuid 2bf127e4-ef8a-483d-a0ec-2a7b5791219a) service to localhost/127.0.0.1:41123 2023-11-26 15:56:07,636 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/cluster_7fe8813b-4787-298e-1dce-07c929e273b6/dfs/data/data1/current/BP-728291432-172.31.14.131-1701013996280] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-26 15:56:07,636 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/1b122781-998b-d97c-ce26-bbe74c819807/cluster_7fe8813b-4787-298e-1dce-07c929e273b6/dfs/data/data2/current/BP-728291432-172.31.14.131-1701013996280] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-26 15:56:07,663 INFO [Listener at localhost/43645] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-26 15:56:07,802 INFO [Listener at localhost/43645] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-11-26 15:56:07,910 INFO [Listener at localhost/43645] hbase.HBaseTestingUtility(1293): Minicluster is down